Apr 25 02:00:59 devstack cinder-volume[72286]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 25 02:00:59 devstack cinder-volume[72286]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 02:00:59 devstack cinder-volume[72286]: we strongly recommend against using it for new projects. Apr 25 02:00:59 devstack cinder-volume[72286]: If you are already using Eventlet, we recommend migrating to a different Apr 25 02:00:59 devstack cinder-volume[72286]: framework. For more detail see Apr 25 02:00:59 devstack cinder-volume[72286]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 02:00:59 devstack cinder-volume[72286]: import eventlet # noqa Apr 25 02:01:01 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 02:01:01 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 02:01:01 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 02:01:02 devstack cinder-volume[72286]: INFO dbcounter [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Registered counter for database cinder Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_db.sqlalchemy.engines [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG dbcounter [-] [72286] Writer thread running {{(pid=72286) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 02:01:02 devstack cinder-volume[72286]: INFO cinder.rpc [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 25 02:01:02 devstack cinder-volume[72286]: INFO cinder.rpc [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_db.sqlalchemy.engines [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:01:02 devstack cinder-volume[72286]: INFO cinder.volume.manager [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Determined volume DB was empty at startup. Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG cinder.volume.manager [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72286) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 25 02:01:02 devstack cinder-volume[72286]: INFO cinder.volume.manager [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 25 02:01:02 devstack cinder-volume[72286]: WARNING stevedore.named [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 25 02:01:02 devstack cinder-volume[72286]: WARNING castellan.key_manager [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 02:01:02 devstack cinder-volume[72286]: WARNING cinder.keymgr.conf_key_mgr [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG cinder.volume.drivers.lvm [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72286) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_concurrency.processutils [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72286) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_concurrency.processutils [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] CMD "cinder-rtstool verify" returned: 0 in 0.251s {{(pid=72286) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_db.sqlalchemy.engines [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:01:02 devstack cinder-volume[72286]: INFO cinder.rpc [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 25 02:01:02 devstack cinder-volume[72286]: INFO cinder.rpc [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 25 02:01:02 devstack cinder-volume[72286]: WARNING stevedore.named [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 25 02:01:02 devstack cinder-volume[72286]: WARNING castellan.key_manager [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 02:01:02 devstack cinder-volume[72286]: INFO cinder.volume.manager [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_db.sqlalchemy.engines [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72286) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:01:02 devstack cinder-volume[72286]: INFO oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Starting 1 workers Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Started child 72396 {{(pid=72286) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Full set of CONF: {{(pid=72286) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] ******************************************************************************** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Configuration options gathered from: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] ================================================================================ {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] allow_availability_zone_fallback = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] allow_compression_on_image_upload = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] allowed_direct_url_schemes = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] api_rate_limit = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] auth_strategy = keystone {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] az_cache_duration = 3600 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_availability_zone = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_host = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_stats_polling_interval = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backup_api_class = cinder.backup.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backup_name_template = backup-%s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backup_use_same_host = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backup_use_temp_snapshot = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] chap_password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] chap_username = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72396]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cinder_internal_tenant_project_id = d83e28a2714d4b5eab06b94465b4b37e {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cinder_internal_tenant_user_id = 23c41ca442d14e14a2476de389d01f72 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cloned_volume_same_az = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cluster = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] compression_format = gzip {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] compute_api_class = cinder.compute.nova.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] config_dir = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] config_source = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] control_exchange = openstack {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] debug = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] default_availability_zone = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] default_group_type = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] default_volume_type = lvmdriver-1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] disk_geometry = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] driver_client_cert = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] driver_client_cert_key = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] driver_data_namespace = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] driver_ssl_cert_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] driver_ssl_cert_verify = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] driver_use_ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] enable_force_upload = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] enable_new_services = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] enable_unsupported_driver = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] enabled_backends = ['lvmdriver-1'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] enforce_multipath_for_image_xfer = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] filter_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_api_insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_api_servers = ['http://192.168.122.254/image'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_api_ssl_compression = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_ca_certificates_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72396]: INFO cinder.volume.manager [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 25 02:01:02 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_catalog_info = image:glance:publicURL {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_num_retries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance_request_timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] goodness_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] graceful_shutdown_timeout = 5 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] group_api_class = cinder.group.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] host = devstack {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_compress_on_upload = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_conversion_address_space_limit = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_conversion_cpu_limit = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_conversion_disable = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_upload_use_cinder_backend = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_upload_use_internal_tenant = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_volume_cache_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_volume_cache_max_count = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] image_volume_cache_max_size_gb = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] init_host_max_objects_retrieval = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] instance_format = [instance: %(uuid)s] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] iscsi_target_flags = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] iscsi_write_cache = on {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] iser_helper = tgtadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] iser_ip_address = 192.168.122.254 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] iser_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] log_color = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] log_config_append = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] log_dir = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] log_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] log_options = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] log_rotate_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] log_rotate_interval_type = days {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] log_rotation_type = none {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] max_age = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] max_logfile_count = 30 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] max_logfile_size_mb = 200 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] max_over_subscription_ratio = 20.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] message_reap_interval = 86400 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] message_ttl = 2592000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] migration_create_volume_timeout_secs = 300 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] monkey_patch = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] monkey_patch_modules = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] my_ip = 192.168.122.254 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] no_snapshot_gb_quota = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] num_iser_scan_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] num_shell_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] num_volume_device_scan_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] nvmeof_conn_info_version = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] nvmet_ns_id = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] nvmet_port_id = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] osapi_max_limit = 1000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] osapi_volume_ext_list = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] osapi_volume_listen = 0.0.0.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] osapi_volume_listen_port = 8776 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] osapi_volume_use_ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] osapi_volume_workers = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] per_volume_size_limit = -1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] periodic_fuzzy_delay = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] periodic_interval = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] project_id_regex = [0-9a-f\-]+ {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] public_endpoint = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] publish_errors = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] quota_backup_gigabytes = 1000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] quota_backups = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:02 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] quota_gigabytes = 1000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] quota_groups = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] quota_snapshots = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] quota_volumes = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] rate_limit_burst = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] rate_limit_except_level = CRITICAL {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] rate_limit_interval = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] reinit_driver_count = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] replication_device = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] report_discard_supported = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] report_interval = 120 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] reservation_clean_interval = 86400 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] reservation_expire = 86400 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] reserved_image_namespaces = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] reserved_percentage = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] rpc_response_timeout = 120 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] run_external_periodic_tasks = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] scst_target_driver = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] scst_target_iqn_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_down_time = 720 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] shell_completion = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] snapshot_name_template = snapshot-%s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] snapshot_same_host = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] state_path = /opt/stack/data/cinder {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] storage_availability_zone = nova {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] storage_protocol = iSCSI {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] syslog_log_facility = LOG_USER {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] target_helper = lioadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] target_ip_address = 192.168.122.254 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] target_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] target_protocol = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] target_secondary_ip_addresses = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] trace_flags = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] transfer_api_class = cinder.transfer.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] transport_url = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] until_refresh = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] use_chap_auth = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] use_default_quota_class = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] use_journal = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] use_json = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] use_multipath_for_image_xfer = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] use_stderr = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] use_syslog = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] verify_glance_signatures = enabled {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_api_class = cinder.volume.api.API {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_backend_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_clear = zero {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_clear_ionice = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_clear_size = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_copy_bps_limit = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_dd_blocksize = 1M {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_name_template = volume-%s {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_service_inithost_offload = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volume_usage_audit_period = month {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] zoning_mode = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_concurrency.disable_process_locking = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.admin_password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.admin_token = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.admin_user = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.auth_admin_prefix = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.auth_port = 35357 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.auth_protocol = https {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.auth_section = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.auth_type = password {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.auth_uri = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.auth_version = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.cache = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.delay_auth_decision = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.http_connect_timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.identity_uri = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.include_service_catalog = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.interface = public {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_password = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:02 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:02 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcache_username = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.region_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.service_token_roles_required = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.service_type = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.token_cache_time = 300 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.254/identity {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.backend = dogpile.cache.null {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.backend_argument = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.backend_expiration_time = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.config_prefix = cache.oslo {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.debug_cache_backend = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.enable_retry_client = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.enable_socket_keepalive = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.enforce_fips_mode = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.expiration_time = 600 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:03 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.hashclient_retry_attempts = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.memcache_dead_retry = 300 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.memcache_pool_maxsize = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.memcache_sasl_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.proxies = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.redis_db = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.redis_sentinel_service_name = mymaster {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.redis_server = localhost:6379 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.retry_attempts = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.retry_delay = 0.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.socket_keepalive_count = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.socket_keepalive_idle = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.socket_keepalive_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.socket_timeout = 1.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.tls_allowed_ciphers = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.tls_cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.tls_certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.tls_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.tls_keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cache.username = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] coordination.backend_url = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.asyncio_connection = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.asyncio_slave_connection = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.backend = sqlalchemy {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.connection = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.connection_debug = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.connection_parameters = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.connection_recycle_time = 3600 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.connection_trace = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.db_inc_retry_interval = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.db_max_retries = 20 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.db_max_retry_interval = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.db_retry_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.max_overflow = 50 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.max_pool_size = 5 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.max_retries = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.mysql_wsrep_sync_wait = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.pool_timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.retry_interval = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.slave_connection = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.sqlite_synchronous = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.synchronous_reader = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] database.use_db_reconnect = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack sudo[72401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 25 02:01:03 devstack sudo[72401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.connection_string = messaging:// {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.es_doc_type = notification {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.es_scroll_size = 10000 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.es_scroll_time = 2m {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.filter_error_trace = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.hmac_keys = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.sentinel_service_name = mymaster {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.socket_timeout = 0.1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.trace_requests = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler.trace_sqlalchemy = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler_jaeger.process_tags = {} {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler_jaeger.service_name_prefix = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] profiler_otlp.service_name_prefix = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.enforce_new_defaults = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: WARNING oslo_config.cfg [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.enforce_scope = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.policy_default_rule = default {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.policy_file = policy.yaml {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_policy.remote_timeout = 60.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] privsep_osbrick.group = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] privsep_osbrick.helper_command = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] privsep_osbrick.user = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cinder_sys_admin.group = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cinder_sys_admin.helper_command = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] cinder_sys_admin.user = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.auth_section = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.auth_type = password {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.collect_timing = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.send_service_user_token = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] service_user.timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.auth_section = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.auth_type = password {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.collect_timing = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.region_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] glance.timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.backend_availability_zone = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.chap_password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.chap_username = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.disk_geometry = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.driver_client_cert = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.driver_client_cert_key = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.driver_data_namespace = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.driver_use_ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.enable_unsupported_driver = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.extra_capabilities = {} {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.filter_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.goodness_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.iscsi_target_flags = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.iscsi_write_cache = on {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.iser_helper = tgtadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.iser_ip_address = 192.168.122.254 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.iser_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.lvm_mirrors = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.lvm_share_target = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.lvm_type = auto {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.num_shell_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.nvmet_port_id = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.replication_device = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.report_discard_supported = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.reserved_percentage = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.scst_target_driver = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.scst_target_iqn_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.storage_protocol = iSCSI {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.target_helper = tgtadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.target_ip_address = 192.168.122.254 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.target_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.target_protocol = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.trace_flags = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.unique_fqdn_network = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.use_chap_auth = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volume_backend_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volume_clear = zero {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volume_clear_ionice = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volume_clear_size = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volume_group = cinder-volumes {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_reports.file_event_handler = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_reports.log_dir = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.backend_availability_zone = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.backend_host = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.chap_password = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.chap_username = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.chiscsi_conf = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.disk_geometry = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.driver_client_cert = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.driver_data_namespace = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.driver_use_ssl = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.extra_capabilities = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.filter_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.goodness_function = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.iser_helper = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.iser_ip_address = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.iser_port = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.iser_target_prefix = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.lvm_conf_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.lvm_mirrors = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.lvm_share_target = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.lvm_type = auto {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.num_shell_tries = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.nvmet_port_id = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.replication_device = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.report_discard_supported = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.reserved_percentage = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.scst_target_driver = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.storage_protocol = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.target_helper = lioadm {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.target_ip_address = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.target_port = 3260 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.target_protocol = iscsi {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.trace_flags = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.use_chap_auth = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volume_clear = zero {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volume_clear_size = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] lvmdriver-1.volumes_dir = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.ssl_version = {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_notifications.driver = [] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_notifications.retry = -1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] oslo_messaging_notifications.transport_url = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] key_manager.fixed_key = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.barbican_api_version = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.barbican_endpoint = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.barbican_endpoint_type = public {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.barbican_region_name = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.collect_timing = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.number_of_retries = 60 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.retry_delay = 1 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.send_service_user_token = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.verify_ssl = True {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican.verify_ssl_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican_service_user.auth_section = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican_service_user.auth_type = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican_service_user.cafile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican_service_user.certfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican_service_user.collect_timing = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican_service_user.insecure = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican_service_user.keyfile = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican_service_user.split_loggers = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] barbican_service_user.timeout = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.approle_role_id = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.approle_secret_id = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.kv_mountpoint = secret {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.kv_path = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.kv_version = 2 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.namespace = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.root_token_id = **** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.ssl_ca_crt_file = None {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.timeout = 60.0 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.use_ssl = False {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:01:03 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] ******************************************************************************** {{(pid=72286) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 25 02:01:03 devstack sudo[72401]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:03 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:03 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:03 devstack sudo[72593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:01:03 devstack sudo[72593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:04 devstack sudo[72593]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:04 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.526s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:04 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:01:04 devstack cinder-volume[72396]: INFO cinder.brick.local_dev.lvm [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 25 02:01:04 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:04 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:04 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:04 devstack sudo[72772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 02:01:04 devstack sudo[72772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:04 devstack sudo[72772]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:04 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:04 devstack cinder-volume[72396]: DEBUG cinder.brick.local_dev.lvm [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72396) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 25 02:01:04 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:04 devstack sudo[72916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:01:04 devstack sudo[72916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:05 devstack sudo[72916]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:05 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.941s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:05 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:05 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:05 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:05 devstack sudo[73074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:01:05 devstack sudo[73074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:06 devstack sudo[73074]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:06 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.480s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:06 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:06 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:06 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:06 devstack sudo[73093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 25 02:01:06 devstack sudo[73093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:06 devstack sudo[73093]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:06 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.489s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:06 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:06 devstack sudo[73096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 02:01:06 devstack sudo[73096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:07 devstack sudo[73096]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:07 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:07 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:07 devstack sudo[73105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 02:01:07 devstack sudo[73105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:07 devstack sudo[73105]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:07 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:07 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:07 devstack sudo[73108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:01:07 devstack sudo[73108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:08 devstack sudo[73108]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:08 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:08 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:08 devstack sudo[73113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:01:08 devstack sudo[73113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:08 devstack sudo[73113]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:08 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.462s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:08 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:08 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:08 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:08 devstack sudo[73117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:01:08 devstack sudo[73117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:09 devstack sudo[73117]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:09 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:09 devstack cinder-volume[72396]: INFO cinder.volume.drivers.lvm [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 25 02:01:09 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:09 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:09 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:09 devstack sudo[73129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:01:09 devstack sudo[73129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:09 devstack sudo[73129]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:09 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.516s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:09 devstack cinder-volume[72396]: DEBUG cinder.volume.drivers.lvm [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Updating volume stats {{(pid=72396) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 02:01:09 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:09 devstack sudo[73237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 02:01:09 devstack sudo[73237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:10 devstack sudo[73237]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:10 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:10 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:10 devstack sudo[73244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:01:10 devstack sudo[73244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:10 devstack sudo[73244]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:10 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:10 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:10 devstack sudo[73311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:01:10 devstack sudo[73311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:11 devstack sudo[73311]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:11 devstack sudo[73389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:01:11 devstack sudo[73389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:11 devstack sudo[73389]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:11 devstack cinder-volume[72396]: INFO cinder.volume.driver [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Driver hasn't implemented _init_vendor_properties() Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG cinder.volume.driver [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72396) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG oslo_db.sqlalchemy.engines [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72396) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG dbcounter [-] [72396] Writer thread running {{(pid=72396) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG cinder.db.sqlalchemy.api [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Building query based on filter {{(pid=72396) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG cinder.image.image_utils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72396) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 25 02:01:11 devstack cinder-volume[72396]: INFO cinder.keymgr.migration [None req-0b368180-38a8-4824-96f5-6292fdb0eacb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG cinder.volume.drivers.lvm [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Updating volume stats {{(pid=72396) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 02:01:11 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:11 devstack sudo[73396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 02:01:11 devstack sudo[73396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:12 devstack sudo[73396]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:12 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:12 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:12 devstack sudo[73400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:01:12 devstack sudo[73400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:12 devstack sudo[73400]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:12 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:12 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:12 devstack sudo[73403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:01:12 devstack sudo[73403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:12 devstack cinder-volume[72286]: DEBUG dbcounter [-] [72286] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72286) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:01:13 devstack sudo[73403]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:13 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:13 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:13 devstack sudo[73408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:01:13 devstack sudo[73408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:13 devstack sudo[73408]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:13 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:13 devstack cinder-volume[72396]: DEBUG cinder.manager [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Notifying Schedulers of capabilities ... {{(pid=72396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:01:13 devstack cinder-volume[72396]: INFO cinder.volume.manager [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Driver initialization completed successfully. Apr 25 02:01:13 devstack cinder-volume[72396]: INFO cinder.manager [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Initiating service 2 cleanup Apr 25 02:01:13 devstack cinder-volume[72396]: INFO cinder.manager [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Service 2 cleanup completed. Apr 25 02:01:13 devstack cinder-volume[72396]: DEBUG cinder.service [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Creating RPC server for service cinder-volume {{(pid=72396) start /opt/stack/cinder/cinder/service.py:231}} Apr 25 02:01:13 devstack cinder-volume[72396]: DEBUG cinder.service [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72396) start /opt/stack/cinder/cinder/service.py:237}} Apr 25 02:01:13 devstack cinder-volume[72396]: INFO cinder.volume.manager [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 25 02:01:13 devstack cinder-volume[72396]: DEBUG cinder.volume.drivers.lvm [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Updating volume stats {{(pid=72396) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 02:01:13 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:13 devstack sudo[73415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 02:01:13 devstack sudo[73415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:14 devstack sudo[73415]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:14 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:14 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:14 devstack sudo[73418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:01:14 devstack sudo[73418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:14 devstack sudo[73418]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:14 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.523s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:14 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:14 devstack sudo[73422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:01:14 devstack sudo[73422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:15 devstack sudo[73422]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:15 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.515s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:15 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:01:15 devstack sudo[73425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:01:15 devstack sudo[73425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:01:15 devstack sudo[73425]: pam_unix(sudo:session): session closed for user root Apr 25 02:01:15 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.484s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:01:15 devstack cinder-volume[72396]: INFO cinder.volume.manager [None req-a0ac0f49-0588-404e-87e0-7d7ffd81f97e None None] Driver post RPC initialization completed successfully. Apr 25 02:01:25 devstack cinder-volume[72396]: DEBUG dbcounter [-] [72396] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72396) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:01:25 devstack cinder-volume[72396]: DEBUG dbcounter [-] [72396] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=72396) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:02:16 devstack cinder-volume[72396]: DEBUG oslo_service.periodic_task [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72396) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:02:16 devstack cinder-volume[72396]: DEBUG cinder.volume.drivers.lvm [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Updating volume stats {{(pid=72396) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 02:02:16 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:02:16 devstack sudo[78157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 02:02:16 devstack sudo[78157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:02:17 devstack sudo[78157]: pam_unix(sudo:session): session closed for user root Apr 25 02:02:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:02:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:02:17 devstack sudo[78200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:02:17 devstack sudo[78200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:02:17 devstack sudo[78200]: pam_unix(sudo:session): session closed for user root Apr 25 02:02:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:02:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:02:17 devstack sudo[78210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:02:17 devstack sudo[78210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:02:18 devstack sudo[78210]: pam_unix(sudo:session): session closed for user root Apr 25 02:02:18 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:02:18 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:02:18 devstack sudo[78214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:02:18 devstack sudo[78214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:02:18 devstack sudo[78214]: pam_unix(sudo:session): session closed for user root Apr 25 02:02:18 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:02:18 devstack cinder-volume[72396]: DEBUG cinder.manager [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Notifying Schedulers of capabilities ... {{(pid=72396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:03:16 devstack cinder-volume[72396]: DEBUG oslo_service.periodic_task [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72396) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:03:16 devstack cinder-volume[72396]: DEBUG cinder.volume.drivers.lvm [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Updating volume stats {{(pid=72396) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 02:03:16 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:03:16 devstack sudo[78578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 02:03:16 devstack sudo[78578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:03:17 devstack sudo[78578]: pam_unix(sudo:session): session closed for user root Apr 25 02:03:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:03:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:03:17 devstack sudo[78583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:03:17 devstack sudo[78583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:03:17 devstack sudo[78583]: pam_unix(sudo:session): session closed for user root Apr 25 02:03:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:03:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:03:17 devstack sudo[78590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:03:17 devstack sudo[78590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:03:18 devstack sudo[78590]: pam_unix(sudo:session): session closed for user root Apr 25 02:03:18 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:03:18 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:03:18 devstack sudo[78830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:03:18 devstack sudo[78830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:03:18 devstack sudo[78830]: pam_unix(sudo:session): session closed for user root Apr 25 02:03:18 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:03:18 devstack cinder-volume[72396]: DEBUG cinder.manager [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Notifying Schedulers of capabilities ... {{(pid=72396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:03:25 devstack cinder-volume[72396]: DEBUG dbcounter [-] [72396] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72396) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:04:16 devstack cinder-volume[72396]: DEBUG oslo_service.periodic_task [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72396) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:04:16 devstack cinder-volume[72396]: DEBUG cinder.volume.drivers.lvm [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Updating volume stats {{(pid=72396) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 02:04:16 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:16 devstack sudo[80724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 02:04:16 devstack sudo[80724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:04:17 devstack sudo[80724]: pam_unix(sudo:session): session closed for user root Apr 25 02:04:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:17 devstack sudo[80728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:04:17 devstack sudo[80728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:04:17 devstack sudo[80728]: pam_unix(sudo:session): session closed for user root Apr 25 02:04:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:17 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:17 devstack sudo[80756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 02:04:17 devstack sudo[80756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:04:18 devstack sudo[80756]: pam_unix(sudo:session): session closed for user root Apr 25 02:04:18 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:18 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:18 devstack sudo[80762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 02:04:18 devstack sudo[80762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:04:18 devstack sudo[80762]: pam_unix(sudo:session): session closed for user root Apr 25 02:04:18 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:18 devstack cinder-volume[72396]: DEBUG cinder.manager [None req-843ff489-98c2-4a11-b23b-1c9427088c5e None None] Notifying Schedulers of capabilities ... {{(pid=72396) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:04:43 devstack cinder-volume[72286]: INFO oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Caught SIGTERM, stopping children Apr 25 02:04:43 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Acquiring lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 02:04:43 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Acquired lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 02:04:43 devstack cinder-volume[72286]: DEBUG oslo_concurrency.lockutils [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Releasing lock "singleton_lock" {{(pid=72286) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 02:04:43 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Stop services. {{(pid=72286) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 25 02:04:43 devstack cinder-volume[72286]: DEBUG oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Killing children. {{(pid=72286) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 25 02:04:43 devstack cinder-volume[72286]: INFO oslo_service.backend._eventlet.service [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Waiting on 1 children to exit Apr 25 02:04:48 devstack cinder-volume[72396]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 25 02:04:48 devstack cinder-volume[81364]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 25 02:04:48 devstack cinder-volume[81364]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 02:04:48 devstack cinder-volume[81364]: we strongly recommend against using it for new projects. Apr 25 02:04:48 devstack cinder-volume[81364]: If you are already using Eventlet, we recommend migrating to a different Apr 25 02:04:48 devstack cinder-volume[81364]: framework. For more detail see Apr 25 02:04:48 devstack cinder-volume[81364]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 02:04:48 devstack cinder-volume[81364]: import eventlet # noqa Apr 25 02:04:48 devstack cinder-volume[72396]: DEBUG oslo_concurrency.lockutils [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Acquiring lock "singleton_lock" {{(pid=72396) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 02:04:48 devstack cinder-volume[72396]: DEBUG oslo_concurrency.lockutils [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Acquired lock "singleton_lock" {{(pid=72396) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 02:04:48 devstack cinder-volume[72396]: DEBUG oslo_concurrency.lockutils [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Releasing lock "singleton_lock" {{(pid=72396) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 02:04:48 devstack cinder-volume[72396]: WARNING amqp [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 25 02:04:48 devstack cinder-volume[72396]: WARNING amqp [None req-944a617f-fd1d-4063-b5b4-e69e6e6a57ef None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 25 02:04:50 devstack cinder-volume[81364]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 02:04:50 devstack cinder-volume[81364]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 02:04:50 devstack cinder-volume[81364]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 02:04:51 devstack cinder-volume[81364]: INFO dbcounter [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Registered counter for database cinder Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81364) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG dbcounter [-] [81364] Writer thread running {{(pid=81364) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 02:04:51 devstack cinder-volume[81364]: INFO cinder.rpc [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 25 02:04:51 devstack cinder-volume[81364]: INFO cinder.rpc [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81364) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:04:51 devstack cinder-volume[81364]: INFO cinder.volume.manager [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Determined volume DB was empty at startup. Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG cinder.volume.manager [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81364) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 25 02:04:51 devstack cinder-volume[81364]: INFO cinder.volume.manager [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 25 02:04:51 devstack cinder-volume[81364]: WARNING stevedore.named [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 25 02:04:51 devstack cinder-volume[81364]: WARNING castellan.key_manager [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 02:04:51 devstack cinder-volume[81364]: WARNING cinder.keymgr.conf_key_mgr [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 02:04:51 devstack cinder-volume[81364]: INFO cinder.volume.manager [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81364) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:04:51 devstack cinder-volume[81364]: INFO oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Starting 1 workers Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Started child 81481 {{(pid=81364) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Full set of CONF: {{(pid=81364) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] ******************************************************************************** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Configuration options gathered from: {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] ================================================================================ {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] allow_availability_zone_fallback = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] allow_compression_on_image_upload = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] allowed_direct_url_schemes = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] api_rate_limit = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] auth_strategy = keystone {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_availability_zone = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_host = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_stats_polling_interval = 60 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backup_api_class = cinder.backup.api.API {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backup_name_template = backup-%s {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backup_use_same_host = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backup_use_temp_snapshot = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] chap_password = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] chap_username = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cinder_internal_tenant_project_id = d83e28a2714d4b5eab06b94465b4b37e {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cinder_internal_tenant_user_id = 23c41ca442d14e14a2476de389d01f72 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cluster = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] compression_format = gzip {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] compute_api_class = cinder.compute.nova.API {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] config_dir = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] config_source = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] control_exchange = openstack {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] debug = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] default_availability_zone = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] default_group_type = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] default_volume_type = QuobyteHD {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] disk_geometry = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] driver_client_cert = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] driver_client_cert_key = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] driver_data_namespace = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] driver_ssl_cert_path = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] driver_ssl_cert_verify = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] driver_use_ssl = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] enable_new_services = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] enable_unsupported_driver = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] enabled_backends = ['QuobyteHD'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] enforce_multipath_for_image_xfer = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] filter_function = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_api_insecure = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_api_servers = ['http://192.168.122.254/image'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_api_ssl_compression = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_ca_certificates_file = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_catalog_info = image:glance:publicURL {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_certfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_keyfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81481]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_num_retries = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance_request_timeout = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] goodness_function = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] graceful_shutdown_timeout = 5 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] group_api_class = cinder.group.api.API {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] host = devstack {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_compress_on_upload = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_conversion_address_space_limit = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_conversion_cpu_limit = 60 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_conversion_disable = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_upload_use_cinder_backend = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_upload_use_internal_tenant = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_volume_cache_enabled = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_volume_cache_max_count = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] image_volume_cache_max_size_gb = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] init_host_max_objects_retrieval = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] instance_format = [instance: %(uuid)s] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] iscsi_target_flags = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] iscsi_write_cache = on {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] iser_helper = tgtadm {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] iser_ip_address = 192.168.122.254 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] iser_port = 3260 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] log_color = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] log_config_append = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] log_dir = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] log_file = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] log_options = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] log_rotate_interval = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] log_rotate_interval_type = days {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] log_rotation_type = none {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] max_age = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] max_logfile_count = 30 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] max_logfile_size_mb = 200 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] max_over_subscription_ratio = 20.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] message_reap_interval = 86400 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] message_ttl = 2592000 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] migration_create_volume_timeout_secs = 300 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81481]: INFO cinder.volume.manager [None req-a6814317-858c-453a-aa25-a323181251ab None None] Starting volume driver QuobyteDriver (1.1.14) Apr 25 02:04:51 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.remotefs [None req-a6814317-858c-453a-aa25-a323181251ab None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81481) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] monkey_patch = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] monkey_patch_modules = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] my_ip = 192.168.122.254 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] no_snapshot_gb_quota = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] num_iser_scan_tries = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] num_shell_tries = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] num_volume_device_scan_tries = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] nvmeof_conn_info_version = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] nvmet_ns_id = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] nvmet_port_id = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] osapi_max_limit = 1000 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] osapi_volume_ext_list = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] osapi_volume_listen_port = 8776 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] osapi_volume_use_ssl = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] osapi_volume_workers = 2 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] per_volume_size_limit = -1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] periodic_fuzzy_delay = 60 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] periodic_interval = 60 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] public_endpoint = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] publish_errors = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] quota_backup_gigabytes = 1000 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] quota_backups = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] quota_gigabytes = 1000 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] quota_groups = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] quota_snapshots = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] quota_volumes = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] rate_limit_burst = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] rate_limit_except_level = CRITICAL {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] rate_limit_interval = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] reinit_driver_count = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] replication_device = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] report_discard_supported = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] report_interval = 120 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] reservation_clean_interval = 86400 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] reservation_expire = 86400 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] reserved_image_namespaces = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] reserved_percentage = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] rpc_response_timeout = 120 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] run_external_periodic_tasks = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] scst_target_driver = iscsi {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] scst_target_iqn_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_down_time = 720 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] shell_completion = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] snapshot_name_template = snapshot-%s {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] split_loggers = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] state_path = /opt/stack/data/cinder {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] storage_availability_zone = nova {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] storage_protocol = iSCSI {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] syslog_log_facility = LOG_USER {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] target_helper = lioadm {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] target_ip_address = 192.168.122.254 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] target_port = 3260 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] target_protocol = iscsi {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] target_secondary_ip_addresses = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] trace_flags = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] transport_url = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81481) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 25 02:04:51 devstack cinder-volume[81481]: WARNING cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 25 02:04:51 devstack cinder-volume[81481]: WARNING cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] until_refresh = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Running cmd (subprocess): mount.quobyte {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] use_chap_auth = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] use_default_quota_class = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] use_journal = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] use_json = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] use_multipath_for_image_xfer = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] use_stderr = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] use_syslog = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] verify_glance_signatures = enabled {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_api_class = cinder.volume.api.API {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_backend_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_clear = zero {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_clear_ionice = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_clear_size = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_copy_bps_limit = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_dd_blocksize = 1M {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_name_template = volume-%s {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_service_inithost_offload = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volume_usage_audit_period = month {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] zoning_mode = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_concurrency.disable_process_locking = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.admin_password = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.admin_token = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.admin_user = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.auth_port = 35357 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.auth_protocol = https {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.auth_section = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.auth_type = password {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.auth_uri = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.auth_version = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.cache = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.certfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.identity_uri = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.include_service_catalog = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.insecure = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.interface = public {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.keyfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_password = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcache_username = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.region_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.service_type = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.254/identity {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.backend = dogpile.cache.null {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.backend_argument = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.backend_expiration_time = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.config_prefix = cache.oslo {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.debug_cache_backend = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.enable_retry_client = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.enable_socket_keepalive = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.enabled = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack quobyte-client[81482]: Reading configuration file: /etc/quobyte/client.cfg Apr 25 02:04:51 devstack quobyte-client[81482]: Invalid parameters found, error: missing mount point. Apr 25 02:04:51 devstack quobyte-client[81482]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 25 02:04:51 devstack quobyte-client[81482]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.enforce_fips_mode = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.expiration_time = 600 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.hashclient_retry_attempts = 2 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.memcache_dead_retry = 300 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.memcache_pool_maxsize = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.memcache_sasl_enabled = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.password = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.proxies = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.redis_db = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.redis_server = localhost:6379 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:04:51 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:04:51 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.retry_attempts = 2 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81481]: INFO cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 ... Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.retry_delay = 0.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 -c /etc/quobyte/client-cinder.cfg {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.socket_keepalive_count = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.socket_keepalive_idle = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.socket_keepalive_interval = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.socket_timeout = 1.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.tls_allowed_ciphers = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.tls_cafile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.tls_certfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.tls_enabled = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.tls_keyfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cache.username = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] coordination.backend_url = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.asyncio_connection = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.asyncio_slave_connection = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.backend = sqlalchemy {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.connection = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.connection_debug = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.connection_parameters = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.connection_recycle_time = 3600 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.connection_trace = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.db_inc_retry_interval = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.db_max_retries = 20 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.db_max_retry_interval = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.db_retry_interval = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.max_overflow = 50 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.max_pool_size = 5 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.max_retries = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.mysql_wsrep_sync_wait = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.pool_timeout = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.retry_interval = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.slave_connection = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.sqlite_synchronous = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.synchronous_reader = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] database.use_db_reconnect = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.connection_string = messaging:// {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.enabled = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.es_doc_type = notification {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.es_scroll_size = 10000 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.es_scroll_time = 2m {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.filter_error_trace = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.hmac_keys = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.sentinel_service_name = mymaster {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.socket_timeout = 0.1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.trace_requests = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler.trace_sqlalchemy = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler_jaeger.process_tags = {} {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler_jaeger.service_name_prefix = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] profiler_otlp.service_name_prefix = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.enforce_new_defaults = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: WARNING oslo_config.cfg [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.enforce_scope = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.policy_default_rule = default {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.policy_file = policy.yaml {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] privsep_osbrick.group = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] privsep_osbrick.helper_command = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] privsep_osbrick.user = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cinder_sys_admin.group = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cinder_sys_admin.helper_command = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] cinder_sys_admin.user = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.auth_section = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.auth_type = password {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.cafile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.certfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.collect_timing = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.insecure = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.keyfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.send_service_user_token = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.split_loggers = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] service_user.timeout = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.auth_section = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.auth_type = password {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.certfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.collect_timing = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.insecure = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.keyfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.region_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.split_loggers = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] glance.timeout = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.backend_availability_zone = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.chap_password = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.chap_username = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.disk_geometry = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.driver_client_cert = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.driver_client_cert_key = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.driver_data_namespace = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.driver_use_ssl = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.extra_capabilities = {} {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.filter_function = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.goodness_function = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.iscsi_target_flags = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.iscsi_write_cache = on {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.iser_helper = tgtadm {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.iser_ip_address = 192.168.122.254 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.iser_port = 3260 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_host = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_login = admin {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_mount_options = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_password = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_private_key = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_share_path = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.num_shell_tries = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.quobyte_volume_url = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.replication_device = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.report_discard_supported = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.reserved_percentage = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack sudo[81483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 -c /etc/quobyte/client-cinder.cfg Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.target_helper = tgtadm {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.target_ip_address = 192.168.122.254 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.target_port = 3260 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.target_protocol = iscsi {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack sudo[81483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.trace_flags = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.unique_fqdn_network = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.use_chap_auth = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.volume_backend_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.volume_clear = zero {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.volume_clear_ionice = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.volume_clear_size = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_reports.file_event_handler = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_reports.log_dir = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.backend_availability_zone = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.backend_host = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.chap_password = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.chap_username = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.chiscsi_conf = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.disk_geometry = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.driver_client_cert = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.driver_data_namespace = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.driver_use_ssl = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.extra_capabilities = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.filter_function = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.goodness_function = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.iser_helper = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.iser_ip_address = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.iser_port = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.iser_target_prefix = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_host = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_login = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_mount_options = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_password = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_private_key = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_share_path = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_ssh_port = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.num_shell_tries = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.nvmet_port_id = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.replication_device = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.report_discard_supported = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.reserved_percentage = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.scst_target_driver = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.storage_protocol = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.target_helper = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.target_ip_address = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.target_port = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.target_prefix = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.target_protocol = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.trace_flags = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.use_chap_auth = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.volume_clear = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.volume_clear_size = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] QuobyteHD.volumes_dir = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.ssl = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_notifications.driver = [] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_notifications.retry = -1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] key_manager.fixed_key = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.barbican_api_version = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.barbican_endpoint = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.barbican_endpoint_type = public {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.barbican_region_name = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.cafile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.certfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.collect_timing = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.insecure = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.keyfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:51 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.number_of_retries = 60 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.retry_delay = 1 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.send_service_user_token = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.split_loggers = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.timeout = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.verify_ssl = True {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican.verify_ssl_path = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican_service_user.auth_section = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican_service_user.auth_type = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican_service_user.cafile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican_service_user.certfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican_service_user.collect_timing = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican_service_user.insecure = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican_service_user.keyfile = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican_service_user.split_loggers = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] barbican_service_user.timeout = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.approle_role_id = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.approle_secret_id = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.kv_mountpoint = secret {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.kv_path = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.kv_version = 2 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.namespace = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.root_token_id = **** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.ssl_ca_crt_file = None {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.timeout = 60.0 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.use_ssl = False {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:04:52 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] ******************************************************************************** {{(pid=81364) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 25 02:04:52 devstack sudo[81483]: pam_unix(sudo:session): session closed for user root Apr 25 02:04:52 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.763s {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:52 devstack cinder-volume[81481]: INFO cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 succeeded Apr 25 02:04:52 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:04:52 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.780s {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:04:52 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:52 devstack sudo[81570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:04:52 devstack sudo[81570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:04:53 devstack sudo[81570]: pam_unix(sudo:session): session closed for user root Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.957s {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:53 devstack cinder-volume[81481]: INFO cinder.volume.driver [None req-a6814317-858c-453a-aa25-a323181251ab None None] Driver hasn't implemented _init_vendor_properties() Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG cinder.volume.driver [None req-a6814317-858c-453a-aa25-a323181251ab None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309913635254, 'free_capacity_gb': 1775.7309913635254, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81481) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG oslo_db.sqlalchemy.engines [None req-a6814317-858c-453a-aa25-a323181251ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81481) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG dbcounter [-] [81481] Writer thread running {{(pid=81481) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG cinder.db.sqlalchemy.api [None req-a6814317-858c-453a-aa25-a323181251ab None None] Building query based on filter {{(pid=81481) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG cinder.image.image_utils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81481) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 25 02:04:53 devstack cinder-volume[81481]: INFO cinder.keymgr.migration [None req-6322857b-24ef-4487-89a4-00b25c189d71 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:04:53 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:53 devstack sudo[81647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:04:53 devstack sudo[81647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:04:54 devstack sudo[81647]: pam_unix(sudo:session): session closed for user root Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.646s {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG cinder.manager [None req-a6814317-858c-453a-aa25-a323181251ab None None] Notifying Schedulers of capabilities ... {{(pid=81481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:04:54 devstack cinder-volume[81481]: INFO cinder.volume.manager [None req-a6814317-858c-453a-aa25-a323181251ab None None] Driver initialization completed successfully. Apr 25 02:04:54 devstack cinder-volume[81481]: INFO cinder.manager [None req-a6814317-858c-453a-aa25-a323181251ab None None] Initiating service 3 cleanup Apr 25 02:04:54 devstack cinder-volume[81481]: INFO cinder.manager [None req-a6814317-858c-453a-aa25-a323181251ab None None] Service 3 cleanup completed. Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG cinder.service [None req-a6814317-858c-453a-aa25-a323181251ab None None] Creating RPC server for service cinder-volume {{(pid=81481) start /opt/stack/cinder/cinder/service.py:231}} Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG cinder.service [None req-a6814317-858c-453a-aa25-a323181251ab None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81481) start /opt/stack/cinder/cinder/service.py:237}} Apr 25 02:04:54 devstack cinder-volume[81481]: INFO cinder.volume.manager [None req-a6814317-858c-453a-aa25-a323181251ab None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.quobyte [None req-a6814317-858c-453a-aa25-a323181251ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:54 devstack sudo[81664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:04:54 devstack sudo[81664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:04:54 devstack sudo[81664]: pam_unix(sudo:session): session closed for user root Apr 25 02:04:54 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-a6814317-858c-453a-aa25-a323181251ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.446s {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:54 devstack cinder-volume[81481]: INFO cinder.volume.manager [None req-a6814317-858c-453a-aa25-a323181251ab None None] Driver post RPC initialization completed successfully. Apr 25 02:04:56 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-c6407802-eb55-4546-8807-689501149361 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:04:56 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-c6407802-eb55-4546-8807-689501149361 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:04:56 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.quobyte [None req-c6407802-eb55-4546-8807-689501149361 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:04:56 devstack cinder-volume[81481]: DEBUG cinder.volume.drivers.quobyte [None req-c6407802-eb55-4546-8807-689501149361 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:04:56 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-c6407802-eb55-4546-8807-689501149361 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81481) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:04:56 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-c6407802-eb55-4546-8807-689501149361 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:04:56 devstack sudo[81737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:04:56 devstack sudo[81737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:04:56 devstack cinder-volume[81364]: INFO oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Caught SIGTERM, stopping children Apr 25 02:04:56 devstack cinder-volume[81364]: DEBUG oslo_concurrency.lockutils [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Acquiring lock "singleton_lock" {{(pid=81364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 02:04:56 devstack cinder-volume[81364]: DEBUG oslo_concurrency.lockutils [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Acquired lock "singleton_lock" {{(pid=81364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 02:04:56 devstack cinder-volume[81364]: DEBUG oslo_concurrency.lockutils [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Releasing lock "singleton_lock" {{(pid=81364) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 02:04:56 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Stop services. {{(pid=81364) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 25 02:04:56 devstack cinder-volume[81364]: DEBUG oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Killing children. {{(pid=81364) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 25 02:04:56 devstack cinder-volume[81364]: INFO oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Waiting on 1 children to exit Apr 25 02:04:56 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Acquiring lock "singleton_lock" {{(pid=81481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 02:04:56 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Acquired lock "singleton_lock" {{(pid=81481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 02:04:56 devstack cinder-volume[81481]: DEBUG oslo_concurrency.lockutils [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Releasing lock "singleton_lock" {{(pid=81481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 02:04:57 devstack sudo[81737]: pam_unix(sudo:session): session closed for user root Apr 25 02:04:57 devstack cinder-volume[81481]: DEBUG oslo_concurrency.processutils [None req-c6407802-eb55-4546-8807-689501149361 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.830s {{(pid=81481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:04:57 devstack cinder-volume[81481]: DEBUG cinder.manager [None req-c6407802-eb55-4546-8807-689501149361 None None] Notifying Schedulers of capabilities ... {{(pid=81481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6407802-eb55-4546-8807-689501149361 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c6407802-eb55-4546-8807-689501149361 None None] Unable to connect to AMQP server on 192.168.122.254:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server [None req-c6407802-eb55-4546-8807-689501149361 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.254:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 558, in _ensured Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 641, in __call__ Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server method() Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server self._producer.publish( Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server return _publish( Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server listener(*args) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server raise error_for_code( Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.254:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 25 02:04:57 devstack cinder-volume[81481]: ERROR oslo_messaging.rpc.server Apr 25 02:04:57 devstack cinder-volume[81481]: WARNING amqp [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 25 02:04:57 devstack cinder-volume[81481]: WARNING amqp [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 25 02:04:57 devstack cinder-volume[81364]: INFO oslo_service.backend._eventlet.service [None req-4eb494fe-fdac-448e-af1a-bfcf5cfd4449 None None] Child 81481 exited with status 0 Apr 25 02:04:57 devstack cinder-volume[81743]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 25 02:04:57 devstack cinder-volume[81743]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 02:04:57 devstack cinder-volume[81743]: we strongly recommend against using it for new projects. Apr 25 02:04:57 devstack cinder-volume[81743]: If you are already using Eventlet, we recommend migrating to a different Apr 25 02:04:57 devstack cinder-volume[81743]: framework. For more detail see Apr 25 02:04:57 devstack cinder-volume[81743]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 02:04:57 devstack cinder-volume[81743]: import eventlet # noqa Apr 25 02:04:59 devstack cinder-volume[81743]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 02:04:59 devstack cinder-volume[81743]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 02:04:59 devstack cinder-volume[81743]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81743) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 02:05:00 devstack cinder-volume[81743]: INFO dbcounter [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Registered counter for database cinder Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_db.sqlalchemy.engines [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG dbcounter [-] [81743] Writer thread running {{(pid=81743) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 02:05:00 devstack cinder-volume[81743]: INFO cinder.rpc [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 25 02:05:00 devstack cinder-volume[81743]: INFO cinder.rpc [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_db.sqlalchemy.engines [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:05:00 devstack cinder-volume[81743]: INFO cinder.volume.manager [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Determined volume DB was empty at startup. Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG cinder.volume.manager [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81743) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 25 02:05:00 devstack cinder-volume[81743]: WARNING stevedore.named [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 25 02:05:00 devstack cinder-volume[81743]: WARNING castellan.key_manager [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 02:05:00 devstack cinder-volume[81743]: WARNING cinder.keymgr.conf_key_mgr [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 02:05:00 devstack cinder-volume[81743]: INFO cinder.volume.manager [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_db.sqlalchemy.engines [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:05:00 devstack cinder-volume[81743]: INFO oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Starting 1 workers Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Started child 81927 {{(pid=81743) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Full set of CONF: {{(pid=81743) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] ******************************************************************************** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Configuration options gathered from: {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] ================================================================================ {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] allow_availability_zone_fallback = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] allow_compression_on_image_upload = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] allowed_direct_url_schemes = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] api_rate_limit = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81927]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] auth_strategy = keystone {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_availability_zone = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_host = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_stats_polling_interval = 60 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backup_api_class = cinder.backup.api.API {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backup_name_template = backup-%s {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backup_use_same_host = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backup_use_temp_snapshot = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] chap_password = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] chap_username = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cinder_internal_tenant_project_id = d83e28a2714d4b5eab06b94465b4b37e {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cinder_internal_tenant_user_id = 23c41ca442d14e14a2476de389d01f72 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cluster = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] compression_format = gzip {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] compute_api_class = cinder.compute.nova.API {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] config_dir = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] config_source = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] control_exchange = openstack {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] debug = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] default_availability_zone = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] default_group_type = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] default_volume_type = QuobyteHD {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] disk_geometry = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] driver_client_cert = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] driver_client_cert_key = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] driver_data_namespace = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] driver_ssl_cert_path = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] driver_ssl_cert_verify = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] driver_use_ssl = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] enable_new_services = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] enable_unsupported_driver = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] enabled_backends = ['QuobyteHD'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] enforce_multipath_for_image_xfer = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] filter_function = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_api_insecure = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_api_servers = ['http://192.168.122.254/image'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_api_ssl_compression = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_ca_certificates_file = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_catalog_info = image:glance:publicURL {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_certfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_keyfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_num_retries = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance_request_timeout = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] goodness_function = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] graceful_shutdown_timeout = 5 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] group_api_class = cinder.group.api.API {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] host = devstack {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_compress_on_upload = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_conversion_address_space_limit = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_conversion_cpu_limit = 60 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_conversion_disable = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_upload_use_cinder_backend = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_upload_use_internal_tenant = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_volume_cache_enabled = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_volume_cache_max_count = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] image_volume_cache_max_size_gb = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] init_host_max_objects_retrieval = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] instance_format = [instance: %(uuid)s] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] iscsi_target_flags = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] iscsi_write_cache = on {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] iser_helper = tgtadm {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] iser_ip_address = 192.168.122.254 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] iser_port = 3260 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] log_color = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] log_config_append = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] log_dir = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] log_file = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] log_options = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] log_rotate_interval = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] log_rotate_interval_type = days {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] log_rotation_type = none {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] max_age = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] max_logfile_count = 30 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] max_logfile_size_mb = 200 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] max_over_subscription_ratio = 20.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] message_reap_interval = 86400 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] message_ttl = 2592000 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] migration_create_volume_timeout_secs = 300 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] monkey_patch = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] monkey_patch_modules = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] my_ip = 192.168.122.254 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] no_snapshot_gb_quota = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] num_iser_scan_tries = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] num_shell_tries = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] num_volume_device_scan_tries = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] nvmeof_conn_info_version = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] nvmet_ns_id = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] nvmet_port_id = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] osapi_max_limit = 1000 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] osapi_volume_ext_list = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] osapi_volume_listen = 0.0.0.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] osapi_volume_listen_port = 8776 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] osapi_volume_use_ssl = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] osapi_volume_workers = 2 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] per_volume_size_limit = -1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] periodic_fuzzy_delay = 60 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] periodic_interval = 60 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] project_id_regex = [0-9a-f\-]+ {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] public_endpoint = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] publish_errors = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] quota_backup_gigabytes = 1000 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] quota_backups = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] quota_gigabytes = 1000 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] quota_groups = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] quota_snapshots = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] quota_volumes = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] rate_limit_burst = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] rate_limit_except_level = CRITICAL {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] rate_limit_interval = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] reinit_driver_count = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] replication_device = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] report_discard_supported = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] report_interval = 120 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] reservation_clean_interval = 86400 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] reservation_expire = 86400 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] reserved_image_namespaces = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] reserved_percentage = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] rpc_response_timeout = 120 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] run_external_periodic_tasks = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] scst_target_driver = iscsi {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] scst_target_iqn_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_down_time = 720 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] shell_completion = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] snapshot_name_template = snapshot-%s {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] split_loggers = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] state_path = /opt/stack/data/cinder {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] storage_availability_zone = nova {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81927) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] storage_protocol = iSCSI {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] syslog_log_facility = LOG_USER {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] target_helper = lioadm {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] target_ip_address = 192.168.122.254 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] target_port = 3260 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] target_protocol = iscsi {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] target_secondary_ip_addresses = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] trace_flags = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] transfer_api_class = cinder.transfer.api.API {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] transport_url = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] until_refresh = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] use_chap_auth = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] use_default_quota_class = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] use_journal = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] use_json = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] use_multipath_for_image_xfer = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] use_stderr = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] use_syslog = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] verify_glance_signatures = enabled {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_api_class = cinder.volume.api.API {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_backend_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_clear = zero {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_clear_ionice = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_clear_size = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_copy_bps_limit = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_dd_blocksize = 1M {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_name_template = volume-%s {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_service_inithost_offload = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volume_usage_audit_period = month {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] zoning_mode = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_concurrency.disable_process_locking = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.admin_password = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.admin_token = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.admin_user = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.auth_admin_prefix = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.auth_port = 35357 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.auth_protocol = https {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.auth_section = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.auth_type = password {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.auth_uri = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.auth_version = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.cache = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.certfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.delay_auth_decision = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.http_connect_timeout = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.identity_uri = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.include_service_catalog = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.insecure = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.interface = public {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.keyfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_password = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcache_username = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81927) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 25 02:05:00 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.quobyte [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.quobyte [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.region_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Running cmd (subprocess): mount.quobyte {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.service_token_roles_required = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.service_type = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.token_cache_time = 300 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.254/identity {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.backend = dogpile.cache.null {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.backend_argument = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.backend_expiration_time = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.config_prefix = cache.oslo {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.debug_cache_backend = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.enable_retry_client = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.enable_socket_keepalive = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.enabled = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.enforce_fips_mode = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.expiration_time = 600 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.hashclient_retry_attempts = 2 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.memcache_dead_retry = 300 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.memcache_pool_maxsize = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.memcache_sasl_enabled = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.password = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.proxies = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.redis_db = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.redis_sentinel_service_name = mymaster {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.redis_server = localhost:6379 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.retry_attempts = 2 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.retry_delay = 0.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.socket_keepalive_count = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.socket_keepalive_idle = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.socket_keepalive_interval = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.socket_timeout = 1.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.tls_allowed_ciphers = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.tls_cafile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.tls_certfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.tls_enabled = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.tls_keyfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cache.username = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] coordination.backend_url = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.asyncio_connection = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.asyncio_slave_connection = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.backend = sqlalchemy {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.connection = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.connection_debug = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.connection_parameters = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.connection_recycle_time = 3600 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.connection_trace = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.db_inc_retry_interval = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.db_max_retries = 20 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.db_max_retry_interval = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.db_retry_interval = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.max_overflow = 50 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.max_pool_size = 5 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.max_retries = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.mysql_wsrep_sync_wait = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.pool_timeout = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.retry_interval = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.slave_connection = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.sqlite_synchronous = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.synchronous_reader = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] database.use_db_reconnect = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.connection_string = messaging:// {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.enabled = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.es_doc_type = notification {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.es_scroll_size = 10000 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.es_scroll_time = 2m {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.filter_error_trace = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.hmac_keys = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.sentinel_service_name = mymaster {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.socket_timeout = 0.1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.trace_requests = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler.trace_sqlalchemy = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler_jaeger.process_tags = {} {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler_jaeger.service_name_prefix = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] profiler_otlp.service_name_prefix = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.enforce_new_defaults = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: WARNING oslo_config.cfg [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.enforce_scope = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.policy_default_rule = default {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.policy_file = policy.yaml {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_policy.remote_timeout = 60.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] privsep_osbrick.group = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] privsep_osbrick.helper_command = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] privsep_osbrick.user = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cinder_sys_admin.group = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cinder_sys_admin.helper_command = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] cinder_sys_admin.user = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.auth_section = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.auth_type = password {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.cafile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.certfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.collect_timing = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.insecure = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.keyfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.send_service_user_token = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.split_loggers = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] service_user.timeout = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.auth_section = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.auth_type = password {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.certfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.collect_timing = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.insecure = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.keyfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.region_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.split_loggers = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] glance.timeout = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.backend_availability_zone = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.chap_password = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.chap_username = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.disk_geometry = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.driver_client_cert = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.driver_client_cert_key = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.driver_data_namespace = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.driver_use_ssl = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.enable_unsupported_driver = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.extra_capabilities = {} {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.filter_function = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.goodness_function = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.iscsi_target_flags = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.iscsi_write_cache = on {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.iser_helper = tgtadm {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.iser_ip_address = 192.168.122.254 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.iser_port = 3260 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_host = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_login = admin {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_mount_options = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_password = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_private_key = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_share_path = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_ssh_port = 22 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.num_shell_tries = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.nvmet_port_id = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.quobyte_client_cfg = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.quobyte_volume_url = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.replication_device = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.report_discard_supported = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.reserved_percentage = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.scst_target_driver = iscsi {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.scst_target_iqn_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.storage_protocol = iSCSI {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.target_helper = tgtadm {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.target_ip_address = 192.168.122.254 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.target_port = 3260 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.target_protocol = iscsi {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.trace_flags = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.unique_fqdn_network = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.use_chap_auth = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.volume_backend_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.volume_clear = zero {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.volume_clear_ionice = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.volume_clear_size = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_reports.file_event_handler = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_reports.log_dir = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.backend_availability_zone = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.backend_host = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.chap_password = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.chap_username = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.chiscsi_conf = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.disk_geometry = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.driver_client_cert = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.driver_client_cert_key = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.driver_data_namespace = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.driver_use_ssl = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.extra_capabilities = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.filter_function = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.goodness_function = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.iscsi_target_flags = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.iscsi_write_cache = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.iser_helper = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.iser_ip_address = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.iser_port = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.iser_target_prefix = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_host = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_login = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_mount_options = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_password = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_private_key = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_share_path = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_ssh_port = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.num_shell_tries = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nvmet_ns_id = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.nvmet_port_id = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.replication_device = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.report_discard_supported = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.reserved_percentage = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.scst_target_driver = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.storage_protocol = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.target_helper = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.target_ip_address = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.target_port = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.target_prefix = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.target_protocol = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.trace_flags = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.unique_fqdn_network = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.use_chap_auth = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.volume_clear = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.volume_clear_ionice = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.volume_clear_size = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] QuobyteHD.volumes_dir = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.ssl = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.ssl_version = {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_notifications.driver = [] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_notifications.retry = -1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] oslo_messaging_notifications.transport_url = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] key_manager.fixed_key = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.barbican_api_version = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.barbican_endpoint = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.barbican_endpoint_type = public {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.barbican_region_name = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.cafile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.certfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.collect_timing = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.insecure = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.keyfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.number_of_retries = 60 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.retry_delay = 1 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.send_service_user_token = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.split_loggers = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.timeout = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.verify_ssl = True {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican.verify_ssl_path = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican_service_user.auth_section = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican_service_user.auth_type = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican_service_user.cafile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican_service_user.certfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican_service_user.collect_timing = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican_service_user.insecure = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican_service_user.keyfile = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican_service_user.split_loggers = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] barbican_service_user.timeout = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.approle_role_id = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.approle_secret_id = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.kv_mountpoint = secret {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.kv_path = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.kv_version = 2 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.namespace = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.root_token_id = **** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.ssl_ca_crt_file = None {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.timeout = 60.0 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.use_ssl = False {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 02:05:00 devstack cinder-volume[81743]: DEBUG oslo_service.backend._eventlet.service [None req-1b7caed2-f8a8-44b3-b89a-750e68c5c44f None None] ******************************************************************************** {{(pid=81743) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 25 02:05:00 devstack quobyte-client[81952]: Reading configuration file: /etc/quobyte/client.cfg Apr 25 02:05:00 devstack quobyte-client[81952]: Invalid parameters found, error: missing mount point. Apr 25 02:05:00 devstack quobyte-client[81952]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 25 02:05:00 devstack quobyte-client[81952]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] CMD "mount.quobyte" returned: 1 in 0.162s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:05:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:05:00 devstack sudo[81963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:05:00 devstack sudo[81963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:05:01 devstack sudo[81963]: pam_unix(sudo:session): session closed for user root Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.736s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:05:01 devstack cinder-volume[81927]: INFO cinder.volume.driver [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Driver hasn't implemented _init_vendor_properties() Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG cinder.volume.driver [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309913635254, 'free_capacity_gb': 1775.7309913635254, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81927) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG oslo_db.sqlalchemy.engines [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81927) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writer thread running {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG cinder.db.sqlalchemy.api [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Building query based on filter {{(pid=81927) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81927) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:05:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:05:01 devstack cinder-volume[81927]: INFO cinder.keymgr.migration [None req-a0a4a9f3-2032-4a7e-82ab-158181289e25 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 25 02:05:01 devstack sudo[81983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:05:01 devstack sudo[81983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:05:02 devstack sudo[81983]: pam_unix(sudo:session): session closed for user root Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.639s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:05:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Driver initialization completed successfully. Apr 25 02:05:02 devstack cinder-volume[81927]: INFO cinder.manager [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Initiating service 3 cleanup Apr 25 02:05:02 devstack cinder-volume[81927]: INFO cinder.manager [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Service 3 cleanup completed. Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG cinder.service [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Creating RPC server for service cinder-volume {{(pid=81927) start /opt/stack/cinder/cinder/service.py:231}} Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG cinder.service [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81927) start /opt/stack/cinder/cinder/service.py:237}} Apr 25 02:05:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:05:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:05:02 devstack sudo[81992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:05:02 devstack sudo[81992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:05:03 devstack sudo[81992]: pam_unix(sudo:session): session closed for user root Apr 25 02:05:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.415s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:05:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dcf84aa3-bc3b-420d-9b1c-78a1271eb756 None None] Driver post RPC initialization completed successfully. Apr 25 02:05:10 devstack cinder-volume[81743]: DEBUG dbcounter [-] [81743] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81743) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:05:12 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=2 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:05:13 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:06:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:06:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:06:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:06:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:11 devstack sudo[82482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:06:11 devstack sudo[82482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:12 devstack sudo[82482]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.396s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:12 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:06:21 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:06:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Flow 'volume_create_manager' (d2312a57-3a5e-45d2-81f8-277eb527892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:06:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f960195-f38c-4b90-a868-a62f8b896bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f960195-f38c-4b90-a868-a62f8b896bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-310814923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b725f024-85a0-420c-a12d-3f047c35ad86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3851362752c6405da0ef12b09a2b05f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:06:22Z,use_quota=True,user_id='813291ad032b46338e51f4c9ff1e79bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3bdfbf-c9e5-4c51-9a0e-1d3aa1a80638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3bdfbf-c9e5-4c51-9a0e-1d3aa1a80638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d885b137-af0f-41f6-9865-d0babb5130eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d885b137-af0f-41f6-9865-d0babb5130eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b725f024-85a0-420c-a12d-3f047c35ad86', 'volume_name': 'volume-b725f024-85a0-420c-a12d-3f047c35ad86', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46560e07-9533-47e2-a143-fb6f58ff982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46560e07-9533-47e2-a143-fb6f58ff982c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275d2541-eb22-41da-8197-ae2f0372d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Volume b725f024-85a0-420c-a12d-3f047c35ad86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b725f024-85a0-420c-a12d-3f047c35ad86', 'volume_size': 1} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-310814923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b725f024-85a0-420c-a12d-3f047c35ad86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3851362752c6405da0ef12b09a2b05f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:06:22Z,use_quota=True,user_id='813291ad032b46338e51f4c9ff1e79bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Creating volume b725f024-85a0-420c-a12d-3f047c35ad86 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:06:22 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:22 devstack sudo[82584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 1073741824 Apr 25 02:06:22 devstack sudo[82584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Flow 'volume_create_manager' (19d635b6-2934-420f-912d-8c5de4127357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71019550-c3d8-4f01-818d-b954e60dd85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71019550-c3d8-4f01-818d-b954e60dd85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-956976555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3839548c-95d8-4e3f-b177-ecacff762f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668137287f4741aba6fd6112042b0de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:06:22Z,use_quota=True,user_id='e43b947fc21740eb864dd0619cdcb1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75113f95-d2a7-449c-80d9-fd753621eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75113f95-d2a7-449c-80d9-fd753621eead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa326a53-3de3-4431-9469-c756afa05e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa326a53-3de3-4431-9469-c756afa05e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3839548c-95d8-4e3f-b177-ecacff762f3d', 'volume_name': 'volume-3839548c-95d8-4e3f-b177-ecacff762f3d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e420ba-0efa-4eee-b34e-1784399fb104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e420ba-0efa-4eee-b34e-1784399fb104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6cb4be6-3e8a-4747-8784-f8ef665a200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:22 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Volume 3839548c-95d8-4e3f-b177-ecacff762f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3839548c-95d8-4e3f-b177-ecacff762f3d', 'volume_size': 1} Apr 25 02:06:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:23 devstack sudo[82584]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 1073741824" returned: 0 in 1.502s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:24 devstack sudo[82905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 Apr 25 02:06:24 devstack sudo[82905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:25 devstack sudo[82905]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86" returned: 0 in 1.492s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] <== create_volume: return (3095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.104s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.585s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-956976555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3839548c-95d8-4e3f-b177-ecacff762f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668137287f4741aba6fd6112042b0de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:06:22Z,use_quota=True,user_id='e43b947fc21740eb864dd0619cdcb1ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Creating volume 3839548c-95d8-4e3f-b177-ecacff762f3d {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:06:25 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275d2541-eb22-41da-8197-ae2f0372d53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b725f024-85a0-420c-a12d-3f047c35ad86', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b425fcec-0251-442d-837f-362c2e9471ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:25 devstack sudo[82953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d 1073741824 Apr 25 02:06:25 devstack sudo[82953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:25 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Volume volume-b725f024-85a0-420c-a12d-3f047c35ad86 (b725f024-85a0-420c-a12d-3f047c35ad86): created successfully Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b425fcec-0251-442d-837f-362c2e9471ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Flow 'volume_create_manager' (d2312a57-3a5e-45d2-81f8-277eb527892b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:06:25 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-efcfa0d6-6f80-4842-9647-aca0af7e548c tempest-DeleteServersTestJSON-541620473 None] Created volume successfully. Apr 25 02:06:27 devstack sudo[82953]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d 1073741824" returned: 0 in 2.477s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:28 devstack sudo[82998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d Apr 25 02:06:28 devstack sudo[82998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:29 devstack sudo[82998]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d" returned: 0 in 1.245s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] <== create_volume: return (3835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:06:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.839s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6cb4be6-3e8a-4747-8784-f8ef665a200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3839548c-95d8-4e3f-b177-ecacff762f3d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce2d40-476f-4ac6-83d6-eb72332ebccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Volume volume-3839548c-95d8-4e3f-b177-ecacff762f3d (3839548c-95d8-4e3f-b177-ecacff762f3d): created successfully Apr 25 02:06:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce2d40-476f-4ac6-83d6-eb72332ebccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Flow 'volume_create_manager' (19d635b6-2934-420f-912d-8c5de4127357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:06:29 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d3ad4911-a8d6-43a4-b600-4d4c67035fb2 tempest-VolumesAdminNegativeTest-2041099625 None] Created volume successfully. Apr 25 02:06:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Acquiring lock "cinder-3839548c-95d8-4e3f-b177-ecacff762f3d-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:06:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "cinder-3839548c-95d8-4e3f-b177-ecacff762f3d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:06:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Acquiring lock "cinder-quobyte-3839548c-95d8-4e3f-b177-ecacff762f3d" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:06:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "cinder-quobyte-3839548c-95d8-4e3f-b177-ecacff762f3d" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:06:31 devstack cinder-volume[81927]: INFO oslo.privsep.daemon [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5dhgflss/privsep.sock'] Apr 25 02:06:32 devstack sudo[83026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5dhgflss/privsep.sock Apr 25 02:06:32 devstack sudo[83026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:32 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 25 02:06:32 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 02:06:32 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 25 02:06:32 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: Apr 25 02:06:32 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 25 02:06:32 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 25 02:06:32 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 02:06:32 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: Apr 25 02:06:32 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 25 02:06:33 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 25 02:06:33 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 02:06:33 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 25 02:06:33 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: Apr 25 02:06:33 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 25 02:06:33 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 25 02:06:33 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 02:06:33 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: Apr 25 02:06:33 devstack cinder-volume[81927]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 25 02:06:34 devstack sudo[83026]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:34 devstack cinder-volume[81927]: INFO oslo.privsep.daemon [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Spawned new privsep daemon via rootwrap Apr 25 02:06:34 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Accepted privsep connection to /tmp/tmp5dhgflss/privsep.sock {{(pid=81927) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 25 02:06:34 devstack cinder-volume[81927]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 25 02:06:34 devstack cinder-volume[81927]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 25 02:06:34 devstack cinder-volume[81927]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 25 02:06:34 devstack cinder-volume[81927]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83061 Apr 25 02:06:34 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e730ee-6e4a-4aea-bf54-a0907e56f288]: (2,) {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:06:34 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f6f140-b506-4b0c-95f1-798cac0392f3]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:06:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:34 devstack sudo[83066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d Apr 25 02:06:34 devstack sudo[83066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:35 devstack sudo[83066]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:35 devstack cinder-volume[81927]: WARNING py.warnings [req-a2f4783a-3e34-4a70-b49d-286bd8de370d req-3a02bd57-c59b-4ca6-ac82-5323071def76 tempest-DeleteServersTestJSON-541620473 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 25 02:06:35 devstack cinder-volume[81927]: .first() Apr 25 02:06:35 devstack cinder-volume[81927]: Apr 25 02:06:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d" returned: 0 in 1.030s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:35 devstack sudo[83110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d Apr 25 02:06:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-a2f4783a-3e34-4a70-b49d-286bd8de370d req-3a02bd57-c59b-4ca6-ac82-5323071def76 tempest-DeleteServersTestJSON-541620473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-a2f4783a-3e34-4a70-b49d-286bd8de370d req-3a02bd57-c59b-4ca6-ac82-5323071def76 tempest-DeleteServersTestJSON-541620473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:35 devstack sudo[83110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:35 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[63842318-9bb9-4449-b271-4d216d65e087]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:06:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-a2f4783a-3e34-4a70-b49d-286bd8de370d req-3a02bd57-c59b-4ca6-ac82-5323071def76 tempest-DeleteServersTestJSON-541620473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:35 devstack sudo[83112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 Apr 25 02:06:35 devstack sudo[83112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:35 devstack sudo[83110]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3839548c-95d8-4e3f-b177-ecacff762f3d" returned: 0 in 0.503s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "cinder-quobyte-3839548c-95d8-4e3f-b177-ecacff762f3d" released by "delete_volume" :: held 4.041s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:06:35 devstack cinder-volume[81927]: WARNING cinder.quota [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:06:35 devstack cinder-volume[81927]: WARNING cinder.quota [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Created reservations ['b17bd769-c7c4-424a-8940-7ba4d202f902', '1c8c3c60-6d3e-4d87-9967-4f314c144137', '8829c4d4-d442-4794-a05c-1e439146b5dd', '11b42dd9-1803-463d-9320-34c8350dd919'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:06:36 devstack sudo[83112]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-a2f4783a-3e34-4a70-b49d-286bd8de370d req-3a02bd57-c59b-4ca6-ac82-5323071def76 tempest-DeleteServersTestJSON-541620473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86" returned: 0 in 0.667s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-a2f4783a-3e34-4a70-b49d-286bd8de370d req-3a02bd57-c59b-4ca6-ac82-5323071def76 tempest-DeleteServersTestJSON-541620473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.687s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:36 devstack sudo[83119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:06:36 devstack sudo[83119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-a2f4783a-3e34-4a70-b49d-286bd8de370d req-3a02bd57-c59b-4ca6-ac82-5323071def76 tempest-DeleteServersTestJSON-541620473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9', 'name': 'volume-b725f024-85a0-420c-a12d-3f047c35ad86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbb2a964-e830-4807-85a5-2e8344a1832a', 'enforce_multipath': True} {{(pid=81927) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 25 02:06:36 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-a2f4783a-3e34-4a70-b49d-286bd8de370d req-3a02bd57-c59b-4ca6-ac82-5323071def76 tempest-DeleteServersTestJSON-541620473 None] attachment_update completed successfully. Apr 25 02:06:36 devstack sudo[83119]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.625s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:06:36 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Deleted volume successfully. Apr 25 02:06:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1d0927ce-232f-4667-97b7-71a52e979295 tempest-VolumesAdminNegativeTest-2041099625 None] Lock "cinder-3839548c-95d8-4e3f-b177-ecacff762f3d-delete_volume" released by "delete_volume" :: held 5.041s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Flow 'volume_create_manager' (0c533de9-1f3f-4506-bf39-ec1b067c8756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9126fa43-b57a-469a-a360-935e16acfad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9126fa43-b57a-469a-a360-935e16acfad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1910916129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9e6bc9-cb4a-490b-967b-d63939d83520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dcf4a1350374a92a56b2308cb56fffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:06:41Z,use_quota=True,user_id='7d0c0881dad344f1ae0bb96be73dc434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d922c40-5e29-435c-843a-e5aca367c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d922c40-5e29-435c-843a-e5aca367c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7b8373-5b7e-4c80-8288-0dfa055f206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7b8373-5b7e-4c80-8288-0dfa055f206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb9e6bc9-cb4a-490b-967b-d63939d83520', 'volume_name': 'volume-cb9e6bc9-cb4a-490b-967b-d63939d83520', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c4e879-73d7-49ba-a10e-f488a9a00798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c4e879-73d7-49ba-a10e-f488a9a00798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41623c0-7510-437f-bc45-8850341003e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:40 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Volume cb9e6bc9-cb4a-490b-967b-d63939d83520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb9e6bc9-cb4a-490b-967b-d63939d83520', 'volume_size': 1} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1910916129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9e6bc9-cb4a-490b-967b-d63939d83520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dcf4a1350374a92a56b2308cb56fffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:06:41Z,use_quota=True,user_id='7d0c0881dad344f1ae0bb96be73dc434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Creating volume cb9e6bc9-cb4a-490b-967b-d63939d83520 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:06:40 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:06:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:40 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 1073741824 Apr 25 02:06:40 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:41 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 1073741824" returned: 0 in 0.874s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:41 devstack sudo[83548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 Apr 25 02:06:41 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:42 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520" returned: 0 in 0.673s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:06:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41623c0-7510-437f-bc45-8850341003e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb9e6bc9-cb4a-490b-967b-d63939d83520', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ec4b84-aa5d-41f3-befe-1172d49b8c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:42 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Volume volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 (cb9e6bc9-cb4a-490b-967b-d63939d83520): created successfully Apr 25 02:06:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ec4b84-aa5d-41f3-befe-1172d49b8c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Flow 'volume_create_manager' (0c533de9-1f3f-4506-bf39-ec1b067c8756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:06:42 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-40e0f2bb-df23-4deb-96dc-4907d92320a0 tempest-ServersNegativeTestJSON-577231831 None] Created volume successfully. Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Flow 'volume_create_manager' (485f4551-96bd-4c55-b018-bc4bd1ec3167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84b6bbc-475d-46e8-a5a4-cae8d7e25f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84b6bbc-475d-46e8-a5a4-cae8d7e25f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1545176467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55734a96-b7c8-4389-8b36-f46e8d70ec0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dcf4a1350374a92a56b2308cb56fffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:06:45Z,use_quota=True,user_id='7d0c0881dad344f1ae0bb96be73dc434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a9ec1e-af82-4bae-a65e-c9b538be5d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a9ec1e-af82-4bae-a65e-c9b538be5d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f52097-be17-4d61-bfc6-2838f5dad381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f52097-be17-4d61-bfc6-2838f5dad381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55734a96-b7c8-4389-8b36-f46e8d70ec0e', 'volume_name': 'volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f663a9b8-4050-43b7-b0d9-bfb7439d797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f663a9b8-4050-43b7-b0d9-bfb7439d797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e5b0f3-a37c-4f68-80f3-9025e201c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:45 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Volume 55734a96-b7c8-4389-8b36-f46e8d70ec0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e', 'volume_size': 1} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1545176467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55734a96-b7c8-4389-8b36-f46e8d70ec0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dcf4a1350374a92a56b2308cb56fffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:06:45Z,use_quota=True,user_id='7d0c0881dad344f1ae0bb96be73dc434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Creating volume 55734a96-b7c8-4389-8b36-f46e8d70ec0e {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:06:45 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:06:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:45 devstack sudo[83608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e 1073741824 Apr 25 02:06:45 devstack sudo[83608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:46 devstack sudo[83608]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e 1073741824" returned: 0 in 0.751s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:46 devstack sudo[83614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e Apr 25 02:06:46 devstack sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:46 devstack sudo[83614]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e" returned: 0 in 0.692s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:47 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:06:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e5b0f3-a37c-4f68-80f3-9025e201c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0125d5-0dff-4dd2-9838-7e1b750b4991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:06:47 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Volume volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e (55734a96-b7c8-4389-8b36-f46e8d70ec0e): created successfully Apr 25 02:06:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0125d5-0dff-4dd2-9838-7e1b750b4991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:06:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Flow 'volume_create_manager' (485f4551-96bd-4c55-b018-bc4bd1ec3167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:06:47 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a369d6c1-b9ca-4c75-99bf-d424e697f041 tempest-ServersNegativeTestJSON-577231831 None] Created volume successfully. Apr 25 02:06:47 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-21a7a63a-fb25-415f-9ee1-63dd9c9325a4 req-85f1145d-2d89-4595-9694-d78ad4ea8d60 tempest-DeleteServersTestJSON-541620473 None] Terminate volume connection completed successfully. Apr 25 02:06:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-21a7a63a-fb25-415f-9ee1-63dd9c9325a4 req-85f1145d-2d89-4595-9694-d78ad4ea8d60 tempest-DeleteServersTestJSON-541620473 None] Deleting attachment cbb2a964-e830-4807-85a5-2e8344a1832a. {{(pid=81927) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 25 02:06:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "cinder-55734a96-b7c8-4389-8b36-f46e8d70ec0e-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:06:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Lock "cinder-55734a96-b7c8-4389-8b36-f46e8d70ec0e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:06:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "cinder-quobyte-55734a96-b7c8-4389-8b36-f46e8d70ec0e" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:06:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Lock "cinder-quobyte-55734a96-b7c8-4389-8b36-f46e8d70ec0e" acquired by "delete_volume" :: waited 0.046s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:06:48 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a333ce54-ffdd-40c9-9c3e-5b248bb2584f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:06:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:48 devstack sudo[83629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e Apr 25 02:06:48 devstack sudo[83629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:48 devstack sudo[83629]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e" returned: 0 in 0.720s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:48 devstack sudo[83634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e Apr 25 02:06:48 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:49 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-55734a96-b7c8-4389-8b36-f46e8d70ec0e" returned: 0 in 0.525s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Lock "cinder-quobyte-55734a96-b7c8-4389-8b36-f46e8d70ec0e" released by "delete_volume" :: held 1.303s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:06:49 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Created reservations ['853ec9fb-0ff2-4fe1-ac78-a9aeb7763114', '1a442078-5749-41ab-8d01-dee7db6e5d02', '12074bf9-bf5e-4c6a-ab2a-ee8932794c3f', '7545bc66-6a7d-41c1-9599-a1d29cdac80d'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:06:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:06:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:06:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:49 devstack sudo[83638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:06:49 devstack sudo[83638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:50 devstack sudo[83638]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.593s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:50 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:06:50 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Deleted volume successfully. Apr 25 02:06:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5c17c6ed-3767-410f-9c6c-9b7baac17438 tempest-ServersNegativeTestJSON-577231831 None] Lock "cinder-55734a96-b7c8-4389-8b36-f46e8d70ec0e-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:06:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "cinder-cb9e6bc9-cb4a-490b-967b-d63939d83520-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:06:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Lock "cinder-cb9e6bc9-cb4a-490b-967b-d63939d83520-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:06:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "cinder-quobyte-cb9e6bc9-cb4a-490b-967b-d63939d83520" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:06:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Lock "cinder-quobyte-cb9e6bc9-cb4a-490b-967b-d63939d83520" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:06:50 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cef5010-25d4-4d96-af83-0ca8d0e6cabb]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:06:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:50 devstack sudo[83641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 Apr 25 02:06:50 devstack sudo[83641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:51 devstack sudo[83641]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520" returned: 0 in 0.604s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:51 devstack sudo[83646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520 Apr 25 02:06:51 devstack sudo[83646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Acquiring lock "cinder-b725f024-85a0-420c-a12d-3f047c35ad86-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Lock "cinder-b725f024-85a0-420c-a12d-3f047c35ad86-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Acquiring lock "cinder-quobyte-b725f024-85a0-420c-a12d-3f047c35ad86" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Lock "cinder-quobyte-b725f024-85a0-420c-a12d-3f047c35ad86" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd9f988-1c3e-4c1f-9542-b25a32e81430]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:51 devstack sudo[83648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 Apr 25 02:06:51 devstack sudo[83648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:51 devstack sudo[83646]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cb9e6bc9-cb4a-490b-967b-d63939d83520" returned: 0 in 0.630s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Lock "cinder-quobyte-cb9e6bc9-cb4a-490b-967b-d63939d83520" released by "delete_volume" :: held 1.281s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Created reservations ['75ed034c-d6d5-4853-aa0d-b1eed54843ff', '6c734a4a-c6fd-44cd-897c-56230191a7fd', '148e5d10-3a9b-4291-a139-0c373b03b9ee', 'e95211d5-4c40-4547-9623-3925edaf495c'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:51 devstack sudo[83654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:06:51 devstack sudo[83654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:51 devstack sudo[83648]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86" returned: 0 in 0.679s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:51 devstack sudo[83656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86 Apr 25 02:06:51 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:52 devstack sudo[83654]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.578s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:06:52 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Deleted volume successfully. Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c4d9a7c6-44c3-4b66-a81f-bc5492e0fb11 tempest-ServersNegativeTestJSON-577231831 None] Lock "cinder-cb9e6bc9-cb4a-490b-967b-d63939d83520-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:06:52 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b725f024-85a0-420c-a12d-3f047c35ad86" returned: 0 in 0.539s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Lock "cinder-quobyte-b725f024-85a0-420c-a12d-3f047c35ad86" released by "delete_volume" :: held 1.281s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Created reservations ['c2c331f8-5a36-46c0-b274-e1801c4426d0', '308a5699-e7c1-40eb-bcaa-5be222b49f8f', '0810226f-fb9e-46ee-ae3c-f586e102537f', 'f05f2010-6e74-428e-92e7-0350a5b4c45f'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:06:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:06:52 devstack sudo[83662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:06:52 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:06:53 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root Apr 25 02:06:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.648s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:06:53 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:06:53 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Deleted volume successfully. Apr 25 02:06:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a493d041-eee3-4f25-b27d-5f5cfacbd1b1 tempest-DeleteServersTestJSON-541620473 None] Lock "cinder-b725f024-85a0-420c-a12d-3f047c35ad86-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=29,cinder:UPDATE=39,cinder:INSERT=10,cinder:DELETE=3 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Flow 'volume_create_manager' (62db4d9b-46e5-4872-811e-baf8b0264e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87f380f-6635-4d78-8abd-2de0e5fd8b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87f380f-6635-4d78-8abd-2de0e5fd8b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1087267188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fdc705-2345-4eb0-b924-11d313afac61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88d282690cce47b1861325ea453c4e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:03Z,use_quota=True,user_id='558c38aed9c0439c8dbedb1040dbe7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1402c2bf-9ab8-463b-897d-bc4394d2cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1402c2bf-9ab8-463b-897d-bc4394d2cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d62598a-08a9-4c16-9d37-711f57bb0e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d62598a-08a9-4c16-9d37-711f57bb0e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fdc705-2345-4eb0-b924-11d313afac61', 'volume_name': 'volume-04fdc705-2345-4eb0-b924-11d313afac61', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6adb5b-196e-413a-8b3f-4ee9584b6725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6adb5b-196e-413a-8b3f-4ee9584b6725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6de0b1-d355-4bf2-964c-11b69b30cdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:02 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Volume 04fdc705-2345-4eb0-b924-11d313afac61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fdc705-2345-4eb0-b924-11d313afac61', 'volume_size': 1} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1087267188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fdc705-2345-4eb0-b924-11d313afac61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='88d282690cce47b1861325ea453c4e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:03Z,use_quota=True,user_id='558c38aed9c0439c8dbedb1040dbe7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Creating volume 04fdc705-2345-4eb0-b924-11d313afac61 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:07:02 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:07:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:02 devstack sudo[83741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61 1073741824 Apr 25 02:07:02 devstack sudo[83741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:03 devstack sudo[83741]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61 1073741824" returned: 0 in 1.013s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:03 devstack sudo[83779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61 Apr 25 02:07:03 devstack sudo[83779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:04 devstack sudo[83779]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61" returned: 0 in 0.653s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:07:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6de0b1-d355-4bf2-964c-11b69b30cdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fdc705-2345-4eb0-b924-11d313afac61', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd4e9e8-cbb5-4860-a587-119dabb8b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:04 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Volume volume-04fdc705-2345-4eb0-b924-11d313afac61 (04fdc705-2345-4eb0-b924-11d313afac61): created successfully Apr 25 02:07:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd4e9e8-cbb5-4860-a587-119dabb8b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Flow 'volume_create_manager' (62db4d9b-46e5-4872-811e-baf8b0264e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-15326041-cac5-49c1-b72f-ef1c7e7e6f39 req-1190d2a8-e041-4341-a7c5-a1e53f26c60d tempest-VolumesGetTestJSON-1180794046 None] Created volume successfully. Apr 25 02:07:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Acquiring lock "cinder-04fdc705-2345-4eb0-b924-11d313afac61-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Lock "cinder-04fdc705-2345-4eb0-b924-11d313afac61-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Acquiring lock "cinder-quobyte-04fdc705-2345-4eb0-b924-11d313afac61" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Lock "cinder-quobyte-04fdc705-2345-4eb0-b924-11d313afac61" acquired by "delete_volume" :: waited 0.048s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:05 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d88658-3ffb-46b5-abaf-50a2f96522c9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:06 devstack sudo[83793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61 Apr 25 02:07:06 devstack sudo[83793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:06 devstack sudo[83793]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61" returned: 0 in 0.991s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:06 devstack sudo[83800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61 Apr 25 02:07:06 devstack sudo[83800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:07 devstack sudo[83800]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-04fdc705-2345-4eb0-b924-11d313afac61" returned: 0 in 0.730s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Lock "cinder-quobyte-04fdc705-2345-4eb0-b924-11d313afac61" released by "delete_volume" :: held 1.805s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:07 devstack cinder-volume[81927]: DEBUG cinder.quota [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Created reservations ['487bc44a-0052-4d4c-8246-8b8aff964949', 'ae9ffd47-0786-4c67-bff9-219b6b787efc', 'd66cc4c3-a660-4945-b966-7f814efbaea6', '6321bdd1-1055-4497-87e9-80e619b0a472'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:07:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:08 devstack sudo[83810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:07:08 devstack sudo[83810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:08 devstack sudo[83810]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.907s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:08 devstack cinder-volume[81927]: DEBUG cinder.manager [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:07:08 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Deleted volume successfully. Apr 25 02:07:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d9243753-3148-487b-ac26-22339c374b0e req-9c0b3529-935a-40ba-a9ab-855ba511b5fb tempest-VolumesGetTestJSON-1180794046 None] Lock "cinder-04fdc705-2345-4eb0-b924-11d313afac61-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:07:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:11 devstack sudo[83820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:07:11 devstack sudo[83820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:12 devstack sudo[83820]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.964s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:12 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=62,cinder:SELECT=50,cinder:INSERT=10,cinder:DELETE=6 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Flow 'volume_create_manager' (11c3e2b5-60c2-4a5e-a14b-7e76ad6edf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec849b59-4c83-45f6-916d-2a85df8e8f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec849b59-4c83-45f6-916d-2a85df8e8f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1430008191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7763e6bc-5400-4ee6-91ff-bae11414c7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2021b12ff450abb5546e156e8169f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:13Z,use_quota=True,user_id='64c132aa41524e908bec7614942f17db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f9a4e6-0f0a-41d4-beac-3e470c47e77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f9a4e6-0f0a-41d4-beac-3e470c47e77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d4ed38-234e-4a06-96c6-dd638e8fe661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d4ed38-234e-4a06-96c6-dd638e8fe661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7763e6bc-5400-4ee6-91ff-bae11414c7a9', 'volume_name': 'volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415def88-9eba-4642-ba2c-95973f5cc4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415def88-9eba-4642-ba2c-95973f5cc4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7f907b-ac3c-44fe-9773-0c24f8cda0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:13 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Volume 7763e6bc-5400-4ee6-91ff-bae11414c7a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9', 'volume_size': 1} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1430008191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7763e6bc-5400-4ee6-91ff-bae11414c7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a2021b12ff450abb5546e156e8169f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:13Z,use_quota=True,user_id='64c132aa41524e908bec7614942f17db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Creating volume 7763e6bc-5400-4ee6-91ff-bae11414c7a9 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:07:13 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:07:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:13 devstack sudo[83824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 1073741824 Apr 25 02:07:13 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:14 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 1073741824" returned: 0 in 1.047s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:14 devstack sudo[83846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 Apr 25 02:07:14 devstack sudo[83846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:15 devstack sudo[83846]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9" returned: 0 in 0.954s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:07:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7f907b-ac3c-44fe-9773-0c24f8cda0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f4567b-2c12-4e4a-9c0c-877f3d60092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:15 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Volume volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 (7763e6bc-5400-4ee6-91ff-bae11414c7a9): created successfully Apr 25 02:07:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f4567b-2c12-4e4a-9c0c-877f3d60092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Flow 'volume_create_manager' (11c3e2b5-60c2-4a5e-a14b-7e76ad6edf35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:15 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-0d69d671-c899-4140-9fe8-0dd5d51ee865 req-7864e6a1-a70c-4a10-af22-2ad95825bf50 tempest-VolumesSnapshotsTestJSON-32561031 None] Created volume successfully. Apr 25 02:07:15 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5a1fadf9-ff0e-4e02-8f95-43ae93c5f204 tempest-GroupsV320Test-1136832539 None] Group tempest-GroupsV320Test-Group-612073826: creating Apr 25 02:07:16 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5a1fadf9-ff0e-4e02-8f95-43ae93c5f204 tempest-GroupsV320Test-1136832539 None] Group tempest-GroupsV320Test-Group-612073826: created successfully Apr 25 02:07:16 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5a1fadf9-ff0e-4e02-8f95-43ae93c5f204 tempest-GroupsV320Test-1136832539 None] Create group completed successfully. Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Creating offline snapshot 2278a9ae-3bcd-4b88-ae7a-677544672688 of volume 7763e6bc-5400-4ee6-91ff-bae11414c7a9 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f786967a-390f-43f6-b671-7fde0bd892ea]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:17 devstack sudo[83888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 Apr 25 02:07:17 devstack sudo[83888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] Created reservations ['edfec5d7-9b7c-4073-8d5d-12cadc5f5953'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:07:17 devstack sudo[83888]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9" returned: 0 in 0.701s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:17 devstack sudo[83896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 1G Apr 25 02:07:17 devstack sudo[83896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:17 devstack sudo[83898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:07:17 devstack sudo[83898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:18 devstack sudo[83898]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.697s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:18 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:07:18 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-eae6cff3-ecb2-4932-8018-e1ac59e1f67c tempest-GroupsV320Test-1136832539 None] Delete group completed successfully. Apr 25 02:07:18 devstack sudo[83896]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 1G" returned: 0 in 0.892s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:18 devstack sudo[83905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 Apr 25 02:07:18 devstack sudo[83905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:19 devstack sudo[83905]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688" returned: 0 in 0.622s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:19 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 is being set with open permissions: ugo+rw Apr 25 02:07:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:19 devstack sudo[83910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 Apr 25 02:07:19 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:20 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688" returned: 0 in 0.746s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:20 devstack sudo[83913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.info Apr 25 02:07:20 devstack sudo[83913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:20 devstack sudo[83913]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.info" returned: 0 in 0.667s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:20 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.info is being set with open permissions: ugo+rw Apr 25 02:07:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:20 devstack sudo[83919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.info Apr 25 02:07:20 devstack sudo[83919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:21 devstack sudo[83919]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.info" returned: 0 in 0.721s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.455s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-0faf47ff-7f93-4096-a176-68bc331eb1f7 req-2858f08e-39b7-401f-b19c-ce8843e635f0 tempest-VolumesSnapshotsTestJSON-32561031 None] Create snapshot completed successfully Apr 25 02:07:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Acquiring lock "cinder-2278a9ae-3bcd-4b88-ae7a-677544672688-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-2278a9ae-3bcd-4b88-ae7a-677544672688-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Acquiring lock "cinder-quobyte-7763e6bc-5400-4ee6-91ff-bae11414c7a9" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-quobyte-7763e6bc-5400-4ee6-91ff-bae11414c7a9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Acquiring lock "cinder-quobyte-2278a9ae-3bcd-4b88-ae7a-677544672688" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-quobyte-2278a9ae-3bcd-4b88-ae7a-677544672688" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Deleting offline snapshot 2278a9ae-3bcd-4b88-ae7a-677544672688 of volume 7763e6bc-5400-4ee6-91ff-bae11414c7a9 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:07:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] snapshot_file for this snap is: volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:07:22 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec394135-e8a4-44ed-82a3-c5842666ffed]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:22 devstack sudo[83929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 Apr 25 02:07:22 devstack sudo[83929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:22 devstack sudo[83929]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688" returned: 0 in 0.894s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:07:22 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[911673f4-cf91-46a9-be12-05a7b121cac0]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:23 devstack sudo[83937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 Apr 25 02:07:23 devstack sudo[83937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:23 devstack sudo[83937]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9" returned: 0 in 0.689s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:23 devstack sudo[83946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 Apr 25 02:07:23 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:24 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688" returned: 0 in 0.645s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:24 devstack sudo[83953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688 Apr 25 02:07:24 devstack sudo[83953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:24 devstack sudo[83953]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9.2278a9ae-3bcd-4b88-ae7a-677544672688" returned: 0 in 0.522s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-quobyte-2278a9ae-3bcd-4b88-ae7a-677544672688" released by "_delete_snapshot" :: held 2.874s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-quobyte-7763e6bc-5400-4ee6-91ff-bae11414c7a9" released by "delete_snapshot" :: held 2.904s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:24 devstack cinder-volume[81927]: WARNING cinder.quota [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:07:24 devstack cinder-volume[81927]: DEBUG cinder.quota [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Created reservations ['a850d295-6f7a-45b6-92d3-9a777d4c55b9', 'ec9ffe34-354c-4fe7-aab3-5aca1f69ad8a', 'cb38e376-4aed-4d84-9516-acfdc4261cc9', '81ecbf58-85c5-476a-9bde-0297b4096e90'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:07:24 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Delete snapshot completed successfully. Apr 25 02:07:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-d8234beb-ebbf-4ec7-b000-eb094661adcc req-36ccfd78-46df-4510-a19b-cfcb1cf2991e tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-2278a9ae-3bcd-4b88-ae7a-677544672688-delete_snapshot" released by "delete_snapshot" :: held 3.081s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Acquiring lock "cinder-7763e6bc-5400-4ee6-91ff-bae11414c7a9-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-7763e6bc-5400-4ee6-91ff-bae11414c7a9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Acquiring lock "cinder-quobyte-7763e6bc-5400-4ee6-91ff-bae11414c7a9" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-quobyte-7763e6bc-5400-4ee6-91ff-bae11414c7a9" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:25 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c265a08-eb12-42d3-b768-28a2f6d90824]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:25 devstack sudo[83990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 Apr 25 02:07:25 devstack sudo[83990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:26 devstack sudo[83990]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9" returned: 0 in 0.536s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:26 devstack sudo[83995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9 Apr 25 02:07:26 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:26 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7763e6bc-5400-4ee6-91ff-bae11414c7a9" returned: 0 in 0.696s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-quobyte-7763e6bc-5400-4ee6-91ff-bae11414c7a9" released by "delete_volume" :: held 1.335s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG cinder.quota [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Created reservations ['13bc316c-80fd-4501-bf67-cba1916ed69c', '1a61cfdb-6091-499c-8b3a-258d10ac338f', '110583ec-1a81-43aa-ac6d-089e95bcc58a', 'de02abd2-60ac-4bf3-8ffc-32f2848ad4d3'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:27 devstack sudo[83998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:07:27 devstack sudo[83998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Flow 'volume_create_manager' (4408cd3e-4502-4fe8-9211-3dce8a5e16e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed09bb4a-fa36-44d2-ad38-b8c9c5bc3a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed09bb4a-fa36-44d2-ad38-b8c9c5bc3a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:27Z,deleted=False,deleted_at=None,display_description='',display_name='099a7289-9c30-4cf8-9810-735e30f74e4c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbd4863-fcf1-45ba-a476-e3a7cba37a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d777411bcb46479cc191512d9073f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:28Z,use_quota=True,user_id='671c4999f79f4f90abc57962a434db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8877a02-f7aa-41e2-be47-acde49e960b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8877a02-f7aa-41e2-be47-acde49e960b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee5be70-842c-4147-a76b-d58b498c10ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee5be70-842c-4147-a76b-d58b498c10ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbd4863-fcf1-45ba-a476-e3a7cba37a1c', 'volume_name': 'volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3e99a9-0e5d-4288-af86-8d7e42d58735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3e99a9-0e5d-4288-af86-8d7e42d58735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a61ff42-e075-4705-a21d-e7ff861cbf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:27 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Volume ecbd4863-fcf1-45ba-a476-e3a7cba37a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c', 'volume_size': 1} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:27Z,deleted=False,deleted_at=None,display_description='',display_name='099a7289-9c30-4cf8-9810-735e30f74e4c-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbd4863-fcf1-45ba-a476-e3a7cba37a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d777411bcb46479cc191512d9073f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:28Z,use_quota=True,user_id='671c4999f79f4f90abc57962a434db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Creating volume ecbd4863-fcf1-45ba-a476-e3a7cba37a1c {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:07:27 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:27 devstack sudo[84005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c 1073741824 Apr 25 02:07:27 devstack sudo[84005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:27 devstack sudo[83998]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.734s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.manager [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:07:27 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Deleted volume successfully. Apr 25 02:07:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-46c60673-4dec-4ec7-a9ef-072a8c1cbb64 req-b8e846d3-fecb-4e00-a982-de1fa3a6b7a9 tempest-VolumesSnapshotsTestJSON-32561031 None] Lock "cinder-7763e6bc-5400-4ee6-91ff-bae11414c7a9-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:28 devstack sudo[84005]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c 1073741824" returned: 0 in 0.927s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:28 devstack sudo[84010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c Apr 25 02:07:28 devstack sudo[84010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:29 devstack sudo[84010]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c" returned: 0 in 0.680s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:07:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a61ff42-e075-4705-a21d-e7ff861cbf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3066367d-eef1-42bf-b938-f0d3af3ea490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Volume volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c (ecbd4863-fcf1-45ba-a476-e3a7cba37a1c): created successfully Apr 25 02:07:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3066367d-eef1-42bf-b938-f0d3af3ea490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Flow 'volume_create_manager' (4408cd3e-4502-4fe8-9211-3dce8a5e16e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:29 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-82aeaf16-607b-4962-8ec4-fc7af12899df tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Created volume successfully. Apr 25 02:07:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-703c94a5-651e-454b-a2d3-a285cba9cc03 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-703c94a5-651e-454b-a2d3-a285cba9cc03 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:31 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1978899-9295-443c-9a3c-f44807fcaa4d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-703c94a5-651e-454b-a2d3-a285cba9cc03 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:31 devstack sudo[84038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c Apr 25 02:07:31 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:32 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-703c94a5-651e-454b-a2d3-a285cba9cc03 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c" returned: 0 in 0.852s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-703c94a5-651e-454b-a2d3-a285cba9cc03 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.875s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-703c94a5-651e-454b-a2d3-a285cba9cc03 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9', 'name': 'volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa759f79-0cec-46f1-9635-68ae7db7f5ef', 'enforce_multipath': True} {{(pid=81927) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 25 02:07:32 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-285652af-68b2-4b3d-bef3-0acfd642d846 req-703c94a5-651e-454b-a2d3-a285cba9cc03 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] attachment_update completed successfully. Apr 25 02:07:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1513c4f3-a11a-4b94-a46b-81201ee27d8a tempest-BackendsCapabilitiesAdminTestsJSON-704548696 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309913635254, 'free_capacity_gb': 1775.7309913635254, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81927) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 25 02:07:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fa18f281-c31f-4b86-a8ad-b01a963920b8 tempest-BackendsCapabilitiesAdminTestsJSON-704548696 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7309913635254, 'free_capacity_gb': 1775.7309913635254, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81927) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 25 02:07:40 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-34ecc514-9a66-4cfe-992c-ba3835bbc2ab tempest-GroupSnapshotsV319Test-1722425176 None] Group tempest-GroupSnapshotsV319Test-Group-1218182778: creating Apr 25 02:07:40 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-34ecc514-9a66-4cfe-992c-ba3835bbc2ab tempest-GroupSnapshotsV319Test-1722425176 None] Group tempest-GroupSnapshotsV319Test-Group-1218182778: created successfully Apr 25 02:07:40 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-34ecc514-9a66-4cfe-992c-ba3835bbc2ab tempest-GroupSnapshotsV319Test-1722425176 None] Create group completed successfully. Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Flow 'volume_create_manager' (0798e9db-7d71-4385-96d7-ed2cc970ec1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd6327d-fd9e-4421-8a31-ad747297627c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd6327d-fd9e-4421-8a31-ad747297627c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1612740729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0436d0af-3faa-43e9-bf1b-d812b29574db,host='devstack@QuobyteHD#QuobyteHD',id=cea28aa0-85ed-40b2-8417-9b9e70a64145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4a8483969a4aa595f8924ba1b4e92f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:43Z,use_quota=True,user_id='60e26a72ac514bd6807da4fdca11c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fb22ba0-e15e-47ef-89f1-ae2be7dd7f78),volume_type_id=3fb22ba0-e15e-47ef-89f1-ae2be7dd7f78)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be215ce3-8461-4b34-a2c5-9ff1a06002f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be215ce3-8461-4b34-a2c5-9ff1a06002f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3e5400-610a-4421-b6d4-91abf0574403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3e5400-610a-4421-b6d4-91abf0574403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea28aa0-85ed-40b2-8417-9b9e70a64145', 'volume_name': 'volume-cea28aa0-85ed-40b2-8417-9b9e70a64145', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d327e798-e4a6-4c10-81bc-f28a0ec9f2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d327e798-e4a6-4c10-81bc-f28a0ec9f2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b94011-f7ca-41f2-ae95-62e921ea32df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:43 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Volume cea28aa0-85ed-40b2-8417-9b9e70a64145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea28aa0-85ed-40b2-8417-9b9e70a64145', 'volume_size': 1} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0436d0af-3faa-43e9-bf1b-d812b29574db,created_at=2026-04-25T00:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1612740729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0436d0af-3faa-43e9-bf1b-d812b29574db,host='devstack@QuobyteHD#QuobyteHD',id=cea28aa0-85ed-40b2-8417-9b9e70a64145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4a8483969a4aa595f8924ba1b4e92f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:43Z,use_quota=True,user_id='60e26a72ac514bd6807da4fdca11c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fb22ba0-e15e-47ef-89f1-ae2be7dd7f78),volume_type_id=3fb22ba0-e15e-47ef-89f1-ae2be7dd7f78)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Creating volume cea28aa0-85ed-40b2-8417-9b9e70a64145 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:07:43 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:07:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:43 devstack sudo[84614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 1073741824 Apr 25 02:07:43 devstack sudo[84614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:45 devstack sudo[84614]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 1073741824" returned: 0 in 1.625s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:45 devstack sudo[84620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 Apr 25 02:07:45 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:46 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145" returned: 0 in 1.116s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:46 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] <== create_volume: return (2863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:07:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.871s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b94011-f7ca-41f2-ae95-62e921ea32df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea28aa0-85ed-40b2-8417-9b9e70a64145', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1696935f-109e-49c6-903e-c82c461a17a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:46 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Volume volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 (cea28aa0-85ed-40b2-8417-9b9e70a64145): created successfully Apr 25 02:07:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1696935f-109e-49c6-903e-c82c461a17a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Flow 'volume_create_manager' (0798e9db-7d71-4385-96d7-ed2cc970ec1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:46 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b15a4d7d-7e2f-4fc0-8066-1593347c9fa3 tempest-GroupSnapshotsV319Test-1722425176 None] Created volume successfully. Apr 25 02:07:47 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] GroupSnapshot c3a1730f-ab12-4c61-9014-1a3d354742e5: creating. Apr 25 02:07:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Group snapshot c3a1730f-ab12-4c61-9014-1a3d354742e5: creating. {{(pid=81927) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 25 02:07:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:48 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Creating offline snapshot 7efd21ec-fe75-4a46-9796-d02b2ee779c3 of volume cea28aa0-85ed-40b2-8417-9b9e70a64145 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:07:48 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ed008d-fec3-4494-9dce-e68ed4ffd4e9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:48 devstack sudo[84629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 Apr 25 02:07:48 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Flow 'volume_create_manager' (2d439957-62eb-4b55-b408-21de14ca541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653f168d-2ceb-4a70-b015-efcf2e811eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653f168d-2ceb-4a70-b015-efcf2e811eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1822541892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cde7c16-ffe1-4ad7-911b-420dac877be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1593ab02c8d14a3886def6b664802abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:49Z,use_quota=True,user_id='058a2460c54b40699b61511b7acc9f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e6774-8d30-4703-8831-86664ea04206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311e6774-8d30-4703-8831-86664ea04206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5850174c-422b-49a1-8bcc-b2008871a573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5850174c-422b-49a1-8bcc-b2008871a573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cde7c16-ffe1-4ad7-911b-420dac877be7', 'volume_name': 'volume-7cde7c16-ffe1-4ad7-911b-420dac877be7', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62af5c39-0ffa-4264-8333-60ab56addc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62af5c39-0ffa-4264-8333-60ab56addc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655b10a3-0574-4daa-9523-c17af3fda192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:49 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Volume 7cde7c16-ffe1-4ad7-911b-420dac877be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cde7c16-ffe1-4ad7-911b-420dac877be7', 'volume_size': 1} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:49 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145" returned: 0 in 1.398s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:49 devstack sudo[84634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 1G Apr 25 02:07:49 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:50 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 1G" returned: 0 in 0.716s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:50 devstack sudo[84639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 Apr 25 02:07:50 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:50 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3" returned: 0 in 0.682s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:50 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:07:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:51 devstack sudo[84652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 Apr 25 02:07:51 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:51 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3" returned: 0 in 0.848s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:51 devstack sudo[84688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.info Apr 25 02:07:51 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:52 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.info" returned: 0 in 0.773s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:52 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:07:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:52 devstack sudo[84717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.info Apr 25 02:07:52 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:53 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.info" returned: 0 in 0.530s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.093s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.015s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1822541892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cde7c16-ffe1-4ad7-911b-420dac877be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1593ab02c8d14a3886def6b664802abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:49Z,use_quota=True,user_id='058a2460c54b40699b61511b7acc9f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Creating volume 7cde7c16-ffe1-4ad7-911b-420dac877be7 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:07:53 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:07:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:53 devstack sudo[84726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 1073741824 Apr 25 02:07:53 devstack sudo[84726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:53 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-2b018c74-ffba-4254-aa70-f82a15014433 tempest-GroupSnapshotsV319Test-1722425176 None] group_snapshot c3a1730f-ab12-4c61-9014-1a3d354742e5: created successfully Apr 25 02:07:54 devstack sudo[84726]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 1073741824" returned: 0 in 0.945s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:54 devstack sudo[84733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 Apr 25 02:07:54 devstack sudo[84733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:54 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] group_snapshot c3a1730f-ab12-4c61-9014-1a3d354742e5: deleting Apr 25 02:07:54 devstack sudo[84733]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7" returned: 0 in 0.700s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655b10a3-0574-4daa-9523-c17af3fda192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cde7c16-ffe1-4ad7-911b-420dac877be7', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbe2925-5002-4b0b-913a-657207f0f179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] group_snapshot c3a1730f-ab12-4c61-9014-1a3d354742e5: deleting {{(pid=81927) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 25 02:07:54 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Volume volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 (7cde7c16-ffe1-4ad7-911b-420dac877be7): created successfully Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbe2925-5002-4b0b-913a-657207f0f179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Flow 'volume_create_manager' (2d439957-62eb-4b55-b408-21de14ca541b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:54 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ea7c0fd2-23a9-46a0-97d1-a7394c91682a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Created volume successfully. Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Acquiring lock "cinder-quobyte-cea28aa0-85ed-40b2-8417-9b9e70a64145" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "cinder-quobyte-cea28aa0-85ed-40b2-8417-9b9e70a64145" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Acquiring lock "cinder-quobyte-7efd21ec-fe75-4a46-9796-d02b2ee779c3" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "cinder-quobyte-7efd21ec-fe75-4a46-9796-d02b2ee779c3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Deleting offline snapshot 7efd21ec-fe75-4a46-9796-d02b2ee779c3 of volume cea28aa0-85ed-40b2-8417-9b9e70a64145 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] snapshot_file for this snap is: volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[8043e66f-4297-4c3c-9631-62348f513eb5]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:55 devstack sudo[84777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 Apr 25 02:07:55 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Acquiring lock "cinder-7cde7c16-ffe1-4ad7-911b-420dac877be7-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "cinder-7cde7c16-ffe1-4ad7-911b-420dac877be7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Acquiring lock "cinder-quobyte-7cde7c16-ffe1-4ad7-911b-420dac877be7" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:55 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3" returned: 0 in 0.625s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cea28aa0-85ed-40b2-8417-9b9e70a64145(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "cinder-quobyte-7cde7c16-ffe1-4ad7-911b-420dac877be7" acquired by "delete_volume" :: waited 0.040s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[20efdc28-8433-49ad-b342-5eb22b9bf8bf]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[65faca91-fc0e-4d70-8f77-18d2d880b20c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:55 devstack sudo[84782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 Apr 25 02:07:55 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:55 devstack sudo[84783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 Apr 25 02:07:55 devstack sudo[84783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:56 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145" returned: 0 in 0.585s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:56 devstack sudo[84792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 Apr 25 02:07:56 devstack sudo[84792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:56 devstack sudo[84783]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7" returned: 0 in 0.636s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:56 devstack sudo[84794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7 Apr 25 02:07:56 devstack sudo[84794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:56 devstack sudo[84794]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7cde7c16-ffe1-4ad7-911b-420dac877be7" returned: 0 in 0.575s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "cinder-quobyte-7cde7c16-ffe1-4ad7-911b-420dac877be7" released by "delete_volume" :: held 1.249s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Created reservations ['1a5a0869-358b-4bd4-81ca-be920f2f1939', 'adf54583-adf4-4109-9943-e57f3e1ec8c2', 'c6db651d-2d5e-4713-9a68-065ee217e1a3', '5971081a-d87a-4faf-b9e2-d6538d000cf8'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:57 devstack sudo[84792]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3" returned: 0 in 0.791s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:57 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:07:57 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:57 devstack sudo[84817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3 Apr 25 02:07:57 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:57 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145.7efd21ec-fe75-4a46-9796-d02b2ee779c3" returned: 0 in 0.587s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "cinder-quobyte-7efd21ec-fe75-4a46-9796-d02b2ee779c3" released by "_delete_snapshot" :: held 2.713s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "cinder-quobyte-cea28aa0-85ed-40b2-8417-9b9e70a64145" released by "delete_snapshot" :: held 2.743s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:57 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.681s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:07:57 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Deleted volume successfully. Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b13f934-8fee-4636-8cca-c639cf2a9b9a tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "cinder-7cde7c16-ffe1-4ad7-911b-420dac877be7-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:07:57 devstack cinder-volume[81927]: WARNING cinder.quota [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1150654251 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1150654251, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:07:57 devstack cinder-volume[81927]: WARNING cinder.quota [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1150654251 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1150654251, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:07:57 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] Created reservations ['4967c5f7-9e0b-47ec-a5db-f8a77411e7bb', '2c13c334-1e83-4a63-b056-fd1e8e7968bc', '7f939e79-f2b7-46b6-bad5-f15df499eb05', '9575f95c-742e-4fd6-ad1e-44d444657244'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:07:58 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-86f1168c-eff4-4db1-8f65-637c4127eb78 tempest-GroupSnapshotsV319Test-1722425176 None] group_snapshot c3a1730f-ab12-4c61-9014-1a3d354742e5: deleted successfully Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Acquiring lock "cinder-quobyte-cea28aa0-85ed-40b2-8417-9b9e70a64145" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "cinder-quobyte-cea28aa0-85ed-40b2-8417-9b9e70a64145" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c0131d-5df6-484f-af8f-ee5b824cd189]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Flow 'volume_create_manager' (84a96d7f-5acb-4f85-be2d-555a19ed2860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bad07fc-4ced-4bc7-8184-d1a8a48aa4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bad07fc-4ced-4bc7-8184-d1a8a48aa4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-975710289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c952f12b-a52e-44ab-b7ba-2405751566e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1593ab02c8d14a3886def6b664802abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:59Z,use_quota=True,user_id='058a2460c54b40699b61511b7acc9f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74767cc-be3d-4f9f-848f-a7e38d2a3839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74767cc-be3d-4f9f-848f-a7e38d2a3839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbd09b8-60ff-4208-b7bf-cf3453fca752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbd09b8-60ff-4208-b7bf-cf3453fca752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c952f12b-a52e-44ab-b7ba-2405751566e6', 'volume_name': 'volume-c952f12b-a52e-44ab-b7ba-2405751566e6', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:58 devstack sudo[84893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f68ddd-9203-4c68-ad11-67002008598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:58 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f68ddd-9203-4c68-ad11-67002008598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e744107e-3db0-4333-8b3d-928ce7f77318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:07:58 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Volume c952f12b-a52e-44ab-b7ba-2405751566e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c952f12b-a52e-44ab-b7ba-2405751566e6', 'volume_size': 1} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-975710289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c952f12b-a52e-44ab-b7ba-2405751566e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1593ab02c8d14a3886def6b664802abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:07:59Z,use_quota=True,user_id='058a2460c54b40699b61511b7acc9f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Creating volume c952f12b-a52e-44ab-b7ba-2405751566e6 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:07:58 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:07:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:59 devstack sudo[84896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6 1073741824 Apr 25 02:07:59 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:07:59 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root Apr 25 02:07:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145" returned: 0 in 0.898s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:07:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:07:59 devstack sudo[84911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145 Apr 25 02:07:59 devstack sudo[84911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:00 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6 1073741824" returned: 0 in 1.052s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:00 devstack sudo[84917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6 Apr 25 02:08:00 devstack sudo[84917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:00 devstack sudo[84911]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cea28aa0-85ed-40b2-8417-9b9e70a64145" returned: 0 in 1.221s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "cinder-quobyte-cea28aa0-85ed-40b2-8417-9b9e70a64145" released by "delete_volume" :: held 2.299s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Created reservations ['5bbd0478-1a21-4acb-a3f4-24e15b357a80'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:08:01 devstack cinder-volume[81927]: WARNING cinder.quota [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1150654251 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1150654251, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Created reservations ['99ed0207-6228-4647-b697-b46a62eb5d52', 'c222e3bd-6ce9-4006-a3ae-8b75c922e46f', 'b1cc9962-0b56-45ca-9208-2d9efb57f55e', '45e3dadd-f944-4c45-93e3-5f441e805c0d'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Flow 'volume_create_manager' (2d52a6ba-be54-47eb-999d-ec4bd1f40ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82348ca1-0069-41e6-8557-be5bef156aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82348ca1-0069-41e6-8557-be5bef156aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1214268464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd2d06e-2ead-44a0-8533-db8001b681a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90279a1369cb4745b2f87c24d4c728da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:08:01Z,use_quota=True,user_id='9be9071365e24a9e86e4f175613dc071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d809636-c74c-47b2-abcd-508b2a0fbe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d809636-c74c-47b2-abcd-508b2a0fbe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce01c5e-ae69-4c81-a990-6487adb99fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce01c5e-ae69-4c81-a990-6487adb99fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd2d06e-2ead-44a0-8533-db8001b681a1', 'volume_name': 'volume-cdd2d06e-2ead-44a0-8533-db8001b681a1', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9804fd7d-c8e3-4e09-a467-e47f7e12e1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:01 devstack sudo[84917]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9804fd7d-c8e3-4e09-a467-e47f7e12e1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde3a8bd-ec75-4dce-9bfc-61c84a15d828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:01 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Volume cdd2d06e-2ead-44a0-8533-db8001b681a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd2d06e-2ead-44a0-8533-db8001b681a1', 'volume_size': 1} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6" returned: 0 in 1.222s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] <== create_volume: return (2389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.393s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.025s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1214268464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd2d06e-2ead-44a0-8533-db8001b681a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90279a1369cb4745b2f87c24d4c728da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:08:01Z,use_quota=True,user_id='9be9071365e24a9e86e4f175613dc071',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Creating volume cdd2d06e-2ead-44a0-8533-db8001b681a1 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:08:01 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e744107e-3db0-4333-8b3d-928ce7f77318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c952f12b-a52e-44ab-b7ba-2405751566e6', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5cb15e-00f6-424d-bfa6-7088569b91ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:01 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 1073741824 Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:01 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:01 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Volume volume-c952f12b-a52e-44ab-b7ba-2405751566e6 (c952f12b-a52e-44ab-b7ba-2405751566e6): created successfully Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5cb15e-00f6-424d-bfa6-7088569b91ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Flow 'volume_create_manager' (84a96d7f-5acb-4f85-be2d-555a19ed2860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:08:01 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:08:01 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b3b17c08-d871-4bf9-bd2f-491765f1b645 tempest-VolumeQuotasAdminTestJSON-1969699027 None] Created volume successfully. Apr 25 02:08:02 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.770s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:02 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:08:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-8292ef44-bd08-4241-a83f-83da6995ff73 tempest-GroupSnapshotsV319Test-1722425176 None] Delete group completed successfully. Apr 25 02:08:02 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 1073741824" returned: 0 in 1.262s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:02 devstack sudo[84965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 Apr 25 02:08:02 devstack sudo[84965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:03 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=86,cinder:SELECT=77,cinder:INSERT=28,cinder:DELETE=6 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:08:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-714f1d68-5e43-4920-b81d-89cab6034c49 tempest-VolumeQuotasAdminTestJSON-441357701 None] Transfer volume completed successfully. Apr 25 02:08:03 devstack sudo[84965]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1" returned: 0 in 1.165s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] <== create_volume: return (2551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:08:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.554s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde3a8bd-ec75-4dce-9bfc-61c84a15d828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd2d06e-2ead-44a0-8533-db8001b681a1', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf777143-8f5b-48c2-a89b-c9565d0841f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:03 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Volume volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 (cdd2d06e-2ead-44a0-8533-db8001b681a1): created successfully Apr 25 02:08:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf777143-8f5b-48c2-a89b-c9565d0841f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Flow 'volume_create_manager' (2d52a6ba-be54-47eb-999d-ec4bd1f40ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:08:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e76d2aa6-817c-4a9c-b76c-2c1519b6fb76 tempest-ServerRescueNegativeTestJSON-570017206 None] Created volume successfully. Apr 25 02:08:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Acquiring lock "cinder-c952f12b-a52e-44ab-b7ba-2405751566e6-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Lock "cinder-c952f12b-a52e-44ab-b7ba-2405751566e6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Acquiring lock "cinder-quobyte-c952f12b-a52e-44ab-b7ba-2405751566e6" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Lock "cinder-quobyte-c952f12b-a52e-44ab-b7ba-2405751566e6" acquired by "delete_volume" :: waited 0.069s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:05 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c5ab19-3568-46b6-be5c-5c9a808586d5]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:05 devstack sudo[84975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6 Apr 25 02:08:05 devstack sudo[84975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:06 devstack sudo[84975]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6" returned: 0 in 1.373s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:06 devstack sudo[84981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6 Apr 25 02:08:06 devstack sudo[84981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:07 devstack sudo[84981]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c952f12b-a52e-44ab-b7ba-2405751566e6" returned: 0 in 1.120s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Lock "cinder-quobyte-c952f12b-a52e-44ab-b7ba-2405751566e6" released by "delete_volume" :: held 2.598s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:08 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Created reservations ['f8827d5a-a023-4ee0-a58d-3cc48c38618d', '3bdf65d0-45ba-4828-b88e-42e5a6f7918f', 'ec00b8c7-85a4-4018-8f2d-381c2b65856c', '2830e68e-07cc-4012-95f1-6316d0181d99'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:08:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:08 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:08:08 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:09 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.440s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:09 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:08:10 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Deleted volume successfully. Apr 25 02:08:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-846295d5-64cf-4a93-ad24-79ae4cefb0d9 tempest-VolumeQuotasAdminTestJSON-2023331028 None] Lock "cinder-c952f12b-a52e-44ab-b7ba-2405751566e6-delete_volume" released by "delete_volume" :: held 4.868s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:08:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:11 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:08:11 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:13 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 2.470s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:13 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=66,cinder:INSERT=10,cinder:UPDATE=65,cinder:DELETE=4 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Flow 'volume_create_manager' (8727232e-698c-4cf9-9dac-198087a85701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918bdd28-e310-40d7-8ce2-209f8483fe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918bdd28-e310-40d7-8ce2-209f8483fe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1083166467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33dc81fc-be63-4320-aa18-8eae095ba57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1342f440b7453f9687782402ecf68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:08:14Z,use_quota=True,user_id='00fc75b0316546cf82c2bb46aa917e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acaddc02-6364-46ae-9a17-3ff8b778b301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acaddc02-6364-46ae-9a17-3ff8b778b301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b3d3a6-898f-4be1-be55-60867eee6070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b3d3a6-898f-4be1-be55-60867eee6070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33dc81fc-be63-4320-aa18-8eae095ba57d', 'volume_name': 'volume-33dc81fc-be63-4320-aa18-8eae095ba57d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313c660e-8984-459d-9dd0-5e428534d9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313c660e-8984-459d-9dd0-5e428534d9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd058f3-adb9-49c7-bfda-d2eae22f7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:14 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Volume 33dc81fc-be63-4320-aa18-8eae095ba57d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33dc81fc-be63-4320-aa18-8eae095ba57d', 'volume_size': 1} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1083166467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33dc81fc-be63-4320-aa18-8eae095ba57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1342f440b7453f9687782402ecf68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:08:14Z,use_quota=True,user_id='00fc75b0316546cf82c2bb46aa917e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Creating volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:08:14 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:08:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:14 devstack sudo[85184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d 1073741824 Apr 25 02:08:14 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:15 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d 1073741824" returned: 0 in 0.881s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:15 devstack sudo[85194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d Apr 25 02:08:15 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:16 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d" returned: 0 in 0.582s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd058f3-adb9-49c7-bfda-d2eae22f7beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33dc81fc-be63-4320-aa18-8eae095ba57d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c8fc2e-ffdc-4ddd-a00f-ae88db3e3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:16 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Volume volume-33dc81fc-be63-4320-aa18-8eae095ba57d (33dc81fc-be63-4320-aa18-8eae095ba57d): created successfully Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15c8fc2e-ffdc-4ddd-a00f-ae88db3e3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Flow 'volume_create_manager' (8727232e-698c-4cf9-9dac-198087a85701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:08:16 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c141cc3e-4c12-498a-803b-f600fa90b555 tempest-SnapshotsActionsTest-1474789483 None] Created volume successfully. Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Creating offline snapshot 51b01a61-53ed-41ec-b8c6-ece96cc6ae5a of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[1305eade-6e14-46d7-b01d-5d1669b35e31]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:16 devstack sudo[85203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d Apr 25 02:08:16 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:17 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d" returned: 0 in 0.771s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:17 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a 1G Apr 25 02:08:17 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:18 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a 1G" returned: 0 in 1.034s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:18 devstack sudo[85272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:18 devstack sudo[85272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:19 devstack sudo[85272]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.791s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:19 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a is being set with open permissions: ugo+rw Apr 25 02:08:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:19 devstack sudo[85278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:19 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:20 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.798s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:20 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.info Apr 25 02:08:20 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Flow 'volume_create_manager' (46ac6c04-7165-4f17-ac2b-3d51cff65b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a310c999-20fe-4ed6-84ed-fecfdc7ec33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a310c999-20fe-4ed6-84ed-fecfdc7ec33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1199572008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e834939-033a-4714-88bd-ab65f862f3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670eff8c6cd84c55b9b1ebb321ff785d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:08:20Z,use_quota=True,user_id='8b3dfff061bb4585bb841217eea9191a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e40de47d-475b-4a58-8fb5-39e803e54a24),volume_type_id=e40de47d-475b-4a58-8fb5-39e803e54a24)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79b5e16-961c-46e3-a759-53fee756d523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79b5e16-961c-46e3-a759-53fee756d523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9609eabd-bb08-4f45-86b6-bf2a6144b48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9609eabd-bb08-4f45-86b6-bf2a6144b48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e834939-033a-4714-88bd-ab65f862f3be', 'volume_name': 'volume-0e834939-033a-4714-88bd-ab65f862f3be', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5080f9-959c-4b01-be00-ad21a3fd3aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5080f9-959c-4b01-be00-ad21a3fd3aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfc7a7e-1b29-4ff6-bbab-0b8fccc06bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:20 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Volume 0e834939-033a-4714-88bd-ab65f862f3be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e834939-033a-4714-88bd-ab65f862f3be', 'volume_size': 1} Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:20 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.info" returned: 0 in 0.631s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:20 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.info is being set with open permissions: ugo+rw Apr 25 02:08:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:20 devstack sudo[85286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.info Apr 25 02:08:20 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:21 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.info" returned: 0 in 0.472s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.648s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.938s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1199572008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e834939-033a-4714-88bd-ab65f862f3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='670eff8c6cd84c55b9b1ebb321ff785d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:08:20Z,use_quota=True,user_id='8b3dfff061bb4585bb841217eea9191a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e40de47d-475b-4a58-8fb5-39e803e54a24),volume_type_id=e40de47d-475b-4a58-8fb5-39e803e54a24)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Creating volume 0e834939-033a-4714-88bd-ab65f862f3be {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:08:21 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:08:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:21 devstack sudo[85289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be 1073741824 Apr 25 02:08:21 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bced12a8-49f5-4d17-95e1-99713b980ba9 tempest-SnapshotsActionsTest-1474789483 None] Create snapshot completed successfully Apr 25 02:08:22 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be 1073741824" returned: 0 in 0.796s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:22 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be Apr 25 02:08:22 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:23 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be" returned: 0 in 0.747s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.094s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Creating offline snapshot 9f4fb940-157c-4a70-bc19-690d147ccdfe of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfc7a7e-1b29-4ff6-bbab-0b8fccc06bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e834939-033a-4714-88bd-ab65f862f3be', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f341b10f-87b6-4c99-83ed-252d78fe2ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[26557f6b-3ed5-4bc7-9b88-2b2f1cd676d9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:23 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Volume volume-0e834939-033a-4714-88bd-ab65f862f3be (0e834939-033a-4714-88bd-ab65f862f3be): created successfully Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f341b10f-87b6-4c99-83ed-252d78fe2ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Flow 'volume_create_manager' (46ac6c04-7165-4f17-ac2b-3d51cff65b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:08:23 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3730b8e3-9f1c-4fbf-9a86-8b8445a8a24b tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Created volume successfully. Apr 25 02:08:23 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:23 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:24 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.870s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:24 devstack sudo[85336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe 1G Apr 25 02:08:24 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ca24c665-0215-4505-8a38-52947caf1f6d tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ca24c665-0215-4505-8a38-52947caf1f6d tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ca24c665-0215-4505-8a38-52947caf1f6d tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ca24c665-0215-4505-8a38-52947caf1f6d tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ca24c665-0215-4505-8a38-52947caf1f6d tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ca24c665-0215-4505-8a38-52947caf1f6d tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:24 devstack sudo[85348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:08:24 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:25 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ca24c665-0215-4505-8a38-52947caf1f6d tempest-VolumeRetypeWithoutMigrationTest-471937892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.749s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-ca24c665-0215-4505-8a38-52947caf1f6d tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:08:25 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ca24c665-0215-4505-8a38-52947caf1f6d tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Retype volume completed successfully. Apr 25 02:08:25 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe 1G" returned: 0 in 1.169s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:25 devstack sudo[85372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe Apr 25 02:08:25 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Acquiring lock "cinder-0e834939-033a-4714-88bd-ab65f862f3be-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "cinder-0e834939-033a-4714-88bd-ab65f862f3be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Acquiring lock "cinder-quobyte-0e834939-033a-4714-88bd-ab65f862f3be" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "cinder-quobyte-0e834939-033a-4714-88bd-ab65f862f3be" acquired by "delete_volume" :: waited 0.045s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52bd769-16a3-4fba-8d9f-36d0cfdfdca7]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:25 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be Apr 25 02:08:25 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:26 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe" returned: 0 in 0.840s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:26 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe is being set with open permissions: ugo+rw Apr 25 02:08:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:26 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe Apr 25 02:08:26 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:26 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe" returned: 0 in 0.669s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.666s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:26 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bcce9c98-1828-42f3-8d38-16e1bb986ee0 tempest-SnapshotsActionsTest-1474789483 None] Create snapshot completed successfully Apr 25 02:08:26 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be" returned: 0 in 1.005s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:26 devstack sudo[85452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be Apr 25 02:08:26 devstack sudo[85452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:27 devstack sudo[85452]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0e834939-033a-4714-88bd-ab65f862f3be" returned: 0 in 0.518s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-9f4fb940-157c-4a70-bc19-690d147ccdfe-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "cinder-quobyte-0e834939-033a-4714-88bd-ab65f862f3be" released by "delete_volume" :: held 1.610s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-9f4fb940-157c-4a70-bc19-690d147ccdfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-quobyte-9f4fb940-157c-4a70-bc19-690d147ccdfe" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-9f4fb940-157c-4a70-bc19-690d147ccdfe" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Deleting offline snapshot 9f4fb940-157c-4a70-bc19-690d147ccdfe of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] snapshot_file for this snap is: volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7947a2-d7c1-4dad-840e-04e018ee4f7a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:27 devstack cinder-volume[81927]: WARNING cinder.quota [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:08:27 devstack cinder-volume[81927]: WARNING cinder.quota [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Created reservations ['8a2a9bc8-c0de-42c8-bd9a-8481073a5632', 'f373a915-e22a-43eb-846a-64cde277d364', 'cc9d1abf-4f0b-4b25-bb20-f7cfa4c823f9', 'c8a51bc4-80fb-494d-818d-7dc5e07fc2d5'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:27 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:08:27 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:27 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe Apr 25 02:08:27 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Acquiring lock "cinder-cdd2d06e-2ead-44a0-8533-db8001b681a1-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "cinder-cdd2d06e-2ead-44a0-8533-db8001b681a1-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:28 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Acquiring lock "cinder-quobyte-cdd2d06e-2ead-44a0-8533-db8001b681a1" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe" returned: 0 in 0.895s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "cinder-quobyte-cdd2d06e-2ead-44a0-8533-db8001b681a1" acquired by "delete_volume" :: waited 0.047s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d87f3b0-eba8-40f6-8e64-3091e6be563a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1cd0b-f9ef-47cb-9302-03c3d9582d49]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:28 devstack sudo[85467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:28 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:28 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.931s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:08:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Deleted volume successfully. Apr 25 02:08:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1880f7a9-8436-4512-8c55-8bdb538ccbf6 tempest-VolumeRetypeWithoutMigrationTest-471937892 None] Lock "cinder-0e834939-033a-4714-88bd-ab65f862f3be-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:28 devstack sudo[85468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 Apr 25 02:08:28 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:29 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 1.008s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:29 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1" returned: 0 in 1.042s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:29 devstack sudo[85481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe Apr 25 02:08:29 devstack sudo[85481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:29 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1 Apr 25 02:08:29 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:30 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cdd2d06e-2ead-44a0-8533-db8001b681a1" returned: 0 in 0.633s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "cinder-quobyte-cdd2d06e-2ead-44a0-8533-db8001b681a1" released by "delete_volume" :: held 1.730s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:30 devstack sudo[85481]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe" returned: 0 in 0.811s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Created reservations ['57f7c56c-19a6-4db5-89dc-49e883e697aa', 'b1eae657-3c70-4f10-912c-7e8e11129b42', '5bc77571-78e5-4d62-b5f1-7bd6715e25d6', 'ad4bd1f2-5b4f-411e-8b90-bf2be8f2a653'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:08:30 devstack sudo[85489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe Apr 25 02:08:30 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:30 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:08:30 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:31 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.9f4fb940-157c-4a70-bc19-690d147ccdfe" returned: 0 in 1.181s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-9f4fb940-157c-4a70-bc19-690d147ccdfe" released by "_delete_snapshot" :: held 4.058s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" released by "delete_snapshot" :: held 4.102s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:31 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Created reservations ['60e41ce8-5168-4708-91e3-f18f86f3e90c', 'fa129364-ef10-4011-b83f-58c6640122d3', '7fc2fb9f-8bf2-4e37-ae7d-0bc7f78c1df2', '8cd363ac-9856-430f-a3e6-f4a4a7f1a79d'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:08:31 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Delete snapshot completed successfully. Apr 25 02:08:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.146s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:31 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:08:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Deleted volume successfully. Apr 25 02:08:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4724ca1b-573a-41e9-a8d7-42bc02707500 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-9f4fb940-157c-4a70-bc19-690d147ccdfe-delete_snapshot" released by "delete_snapshot" :: held 4.376s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-835ef32b-2476-4055-9f50-de798535e78c tempest-ServerRescueNegativeTestJSON-570017206 None] Lock "cinder-cdd2d06e-2ead-44a0-8533-db8001b681a1-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Creating offline snapshot c76291be-699b-4b4c-ab07-5628ffd5d69d of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:08:33 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e592c5-a7ab-46ed-b54c-c6e19de9492d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:34 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:34 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:34 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 1.101s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:34 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d 1G Apr 25 02:08:34 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:36 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d 1G" returned: 0 in 1.495s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:36 devstack sudo[85600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d Apr 25 02:08:36 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:37 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d" returned: 0 in 1.096s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:37 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d is being set with open permissions: ugo+rw Apr 25 02:08:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:37 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d Apr 25 02:08:37 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:38 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d" returned: 0 in 1.013s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.169s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:38 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-35b1c4b2-1dcf-402e-8da4-d52af9847f1d tempest-SnapshotsActionsTest-1474789483 None] Create snapshot completed successfully Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-c76291be-699b-4b4c-ab07-5628ffd5d69d-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-c76291be-699b-4b4c-ab07-5628ffd5d69d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" acquired by "delete_snapshot" :: waited 0.080s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-quobyte-c76291be-699b-4b4c-ab07-5628ffd5d69d" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-c76291be-699b-4b4c-ab07-5628ffd5d69d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Deleting offline snapshot c76291be-699b-4b4c-ab07-5628ffd5d69d of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] snapshot_file for this snap is: volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f3f4a7-e1ef-4f1f-b737-7d01b9f59838]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:39 devstack sudo[85609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d Apr 25 02:08:39 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:40 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d" returned: 0 in 0.983s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d084f4a-eb1a-40c7-b6ef-5b973ef19965]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:40 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:40 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:41 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 1.140s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:41 devstack sudo[85651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d Apr 25 02:08:41 devstack sudo[85651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:42 devstack sudo[85651]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d" returned: 0 in 1.004s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:42 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d Apr 25 02:08:42 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:43 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.c76291be-699b-4b4c-ab07-5628ffd5d69d" returned: 0 in 0.765s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-c76291be-699b-4b4c-ab07-5628ffd5d69d" released by "_delete_snapshot" :: held 4.182s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" released by "delete_snapshot" :: held 4.224s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:43 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Created reservations ['5d7229b8-c4ee-40cf-a1e7-b8ead544ef8c', '40a0fdb1-a880-464f-9b77-99375bb52af7', 'a0f814f1-765b-46a1-bebd-059db18a7fee', 'fea6becf-55fa-46d4-bc7c-8e09754bc4d4'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:08:43 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Delete snapshot completed successfully. Apr 25 02:08:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0ba6693b-bd36-4e47-8c09-d38412e063b5 tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-c76291be-699b-4b4c-ab07-5628ffd5d69d-delete_snapshot" released by "delete_snapshot" :: held 4.601s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Creating offline snapshot 7536db07-e5cb-4012-bb16-4cdd99cc9b42 of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:08:45 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b5ca8-c2d0-4a2f-9f15-d787205f8958]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:45 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:45 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:45 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.756s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:45 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 1G Apr 25 02:08:45 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:46 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 1G" returned: 0 in 0.996s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:46 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 Apr 25 02:08:46 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:47 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42" returned: 0 in 0.860s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:47 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 is being set with open permissions: ugo+rw Apr 25 02:08:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:47 devstack sudo[85716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 Apr 25 02:08:47 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:48 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42" returned: 0 in 0.654s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.491s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d57fe2cc-65b4-44a0-a357-35542c916420 tempest-SnapshotsActionsTest-1474789483 None] Create snapshot completed successfully Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-7536db07-e5cb-4012-bb16-4cdd99cc9b42-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-7536db07-e5cb-4012-bb16-4cdd99cc9b42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-quobyte-7536db07-e5cb-4012-bb16-4cdd99cc9b42" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-7536db07-e5cb-4012-bb16-4cdd99cc9b42" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Deleting offline snapshot 7536db07-e5cb-4012-bb16-4cdd99cc9b42 of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] snapshot_file for this snap is: volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106c3a8-021e-406d-99a9-dcd74fed1061]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:49 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 Apr 25 02:08:49 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:50 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42" returned: 0 in 0.790s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:50 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f633e8-eeb4-46b9-b44c-804dc6c398a1]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:50 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:50 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:51 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.913s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:51 devstack sudo[85759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 Apr 25 02:08:51 devstack sudo[85759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:52 devstack sudo[85759]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42" returned: 0 in 0.833s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:52 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42 Apr 25 02:08:52 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:52 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.7536db07-e5cb-4012-bb16-4cdd99cc9b42" returned: 0 in 0.656s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-7536db07-e5cb-4012-bb16-4cdd99cc9b42" released by "_delete_snapshot" :: held 3.317s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" released by "delete_snapshot" :: held 3.345s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:52 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Created reservations ['2c384740-d503-42eb-9740-704b0e5a2577', '95a612b9-40e2-4286-949a-411d4e64cb44', '299f98da-ae2e-43c0-be1e-911b4d7ee3a5', '613e0d2d-bda6-42ed-8e04-e5746612f502'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:08:52 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Delete snapshot completed successfully. Apr 25 02:08:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8c3bdc44-8fd9-4cc2-8d14-d2f013b6651d tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-7536db07-e5cb-4012-bb16-4cdd99cc9b42-delete_snapshot" released by "delete_snapshot" :: held 3.511s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:08:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Creating offline snapshot 55665be8-6ed7-4313-ab02-6b130a89d987 of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:08:54 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e338c-bc86-46b2-8d96-9afbd3d63a7f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:54 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:54 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:54 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.729s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:54 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 1G Apr 25 02:08:54 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:55 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 1G" returned: 0 in 0.816s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:55 devstack sudo[85780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 Apr 25 02:08:55 devstack sudo[85780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:56 devstack sudo[85780]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987" returned: 0 in 0.641s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:56 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 is being set with open permissions: ugo+rw Apr 25 02:08:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:56 devstack sudo[85785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 Apr 25 02:08:56 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:57 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987" returned: 0 in 0.640s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:57 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f8a39b4e-3a5c-46a1-82b9-1bc666fcc9ab tempest-SnapshotsActionsTest-1474789483 None] Create snapshot completed successfully Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-55665be8-6ed7-4313-ab02-6b130a89d987-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-55665be8-6ed7-4313-ab02-6b130a89d987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" acquired by "delete_snapshot" :: waited 0.050s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Acquiring lock "cinder-quobyte-55665be8-6ed7-4313-ab02-6b130a89d987" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-55665be8-6ed7-4313-ab02-6b130a89d987" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Deleting offline snapshot 55665be8-6ed7-4313-ab02-6b130a89d987 of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] snapshot_file for this snap is: volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8be53-3c02-451a-85a3-6e0dbbeadedb]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:57 devstack sudo[85789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 Apr 25 02:08:57 devstack sudo[85789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:58 devstack sudo[85789]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987" returned: 0 in 0.997s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ec5995-866e-4b66-b807-d38783188054]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:58 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:08:58 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Flow 'volume_create_manager' (4103398d-358a-4a6d-ae4b-b791bbf63129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41edb803-a8a5-4c93-a0e0-79a266f31c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41edb803-a8a5-4c93-a0e0-79a266f31c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:58Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8655fb5-9e99-4293-8b28-6f8c8446256a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d777411bcb46479cc191512d9073f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:08:59Z,use_quota=True,user_id='671c4999f79f4f90abc57962a434db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780866bd-04fb-4554-bdca-241898177d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780866bd-04fb-4554-bdca-241898177d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922dd6e5-ec50-48b9-a551-37792418b196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:58 devstack cinder-volume[81927]: DEBUG cinder.image.glance [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Creating Keystone auth plugin from conf {{(pid=81927) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 25 02:08:59 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.865s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922dd6e5-ec50-48b9-a551-37792418b196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8655fb5-9e99-4293-8b28-6f8c8446256a', 'volume_name': 'volume-f8655fb5-9e99-4293-8b28-6f8c8446256a', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:59 devstack sudo[85801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 Apr 25 02:08:59 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c16ce12-11cb-40bb-b1a2-73174a76bc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c16ce12-11cb-40bb-b1a2-73174a76bc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9263ed-13d8-4afd-9036-6f9254bf6be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:59 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Volume f8655fb5-9e99-4293-8b28-6f8c8446256a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8655fb5-9e99-4293-8b28-6f8c8446256a', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Trying to clone f8655fb5-9e99-4293-8b28-6f8c8446256a from image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]). {{(pid=81927) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Flow 'volume_create_manager' (74130775-a4e9-4bbb-a3d9-e70ca9a311a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa5564b-0909-48d4-a4e1-a705a096b715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa5564b-0909-48d4-a4e1-a705a096b715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1893827131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480c0fa7-7bd0-4761-bc34-612d882f83f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb1da6e08394f73bc518aab76b5b2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:00Z,use_quota=True,user_id='e985e8842b054f59bf13d7682945cf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f92f8-2422-4d90-95c4-05dce253b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622f92f8-2422-4d90-95c4-05dce253b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e72ca2-c90f-4512-a276-375ed38982a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e72ca2-c90f-4512-a276-375ed38982a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480c0fa7-7bd0-4761-bc34-612d882f83f2', 'volume_name': 'volume-480c0fa7-7bd0-4761-bc34-612d882f83f2', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3caa42-f179-4434-972a-cf3fabbfd5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3caa42-f179-4434-972a-cf3fabbfd5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dfcec2-563c-48c1-ac6f-716122d35050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:08:59 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Volume 480c0fa7-7bd0-4761-bc34-612d882f83f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480c0fa7-7bd0-4761-bc34-612d882f83f2', 'volume_size': 1} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1893827131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480c0fa7-7bd0-4761-bc34-612d882f83f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb1da6e08394f73bc518aab76b5b2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:00Z,use_quota=True,user_id='e985e8842b054f59bf13d7682945cf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Creating volume 480c0fa7-7bd0-4761-bc34-612d882f83f2 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:08:59 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:08:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:08:59 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 1073741824 Apr 25 02:08:59 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 25 02:09:00 devstack cinder-volume[81927]: INFO cinder.image.image_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Image download 20.69 MB at 20.69 MB/s Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0d6ff9-c6bf-448d-b5c8-4601110993b8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:00 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD Apr 25 02:09:00 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:00 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987" returned: 0 in 0.941s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:00 devstack sudo[85833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987 Apr 25 02:09:00 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:00 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 1073741824" returned: 0 in 0.909s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:00 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD" returned: 0 in 0.737s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Temporary image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 is fetched for user 671c4999f79f4f90abc57962a434db4c. {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 25 02:09:00 devstack sudo[85839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 Apr 25 02:09:00 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c32f11-6ad8-443a-b4ce-9be9a46e8f85]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:00 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD Apr 25 02:09:00 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:01 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.55665be8-6ed7-4313-ab02-6b130a89d987" returned: 0 in 0.774s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-55665be8-6ed7-4313-ab02-6b130a89d987" released by "_delete_snapshot" :: held 3.717s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" released by "delete_snapshot" :: held 3.768s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Created reservations ['bcfba982-3857-4305-80c2-88e8c066c934', '7f406e05-c82b-49cc-b1fa-786cb09f83ac', 'bc036bbf-8323-4270-a492-da3f6191b897', '68da93a7-492b-465a-9b15-5abdb71d4580'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Delete snapshot completed successfully. Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9aae436-d750-4977-97b7-e3deb1338d4c tempest-SnapshotsActionsTest-1876987578 None] Lock "cinder-55665be8-6ed7-4313-ab02-6b130a89d987-delete_snapshot" released by "delete_snapshot" :: held 3.938s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:01 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2" returned: 0 in 0.587s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dfcec2-563c-48c1-ac6f-716122d35050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480c0fa7-7bd0-4761-bc34-612d882f83f2', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ee1d1c-bd28-496b-9061-e5b246869e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:01 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Volume volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 (480c0fa7-7bd0-4761-bc34-612d882f83f2): created successfully Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ee1d1c-bd28-496b-9061-e5b246869e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Flow 'volume_create_manager' (74130775-a4e9-4bbb-a3d9-e70ca9a311a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0a481567-a411-4edb-a355-182acf492092 tempest-VolumesListAdminTestJSON-1184899302 None] Created volume successfully. Apr 25 02:09:01 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD" returned: 0 in 0.567s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:08:58Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8655fb5-9e99-4293-8b28-6f8c8446256a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29d777411bcb46479cc191512d9073f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:08:59Z,use_quota=True,user_id='671c4999f79f4f90abc57962a434db4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Creating volume f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:09:01 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:09:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:01 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a 1073741824 Apr 25 02:09:01 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "cinder-51b01a61-53ed-41ec-b8c6-ece96cc6ae5a-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-51b01a61-53ed-41ec-b8c6-ece96cc6ae5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "cinder-quobyte-51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-quobyte-51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Deleting offline snapshot 51b01a61-53ed-41ec-b8c6-ece96cc6ae5a of volume 33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] snapshot_file for this snap is: volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[27be6495-8e38-453c-a951-4646627e9762]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:09:02 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:09:02 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:02 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Flow 'volume_create_manager' (b2b1f12a-d57e-49d1-9405-43b1c718a9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb8a62a-6414-4629-81ad-951e7e1b2d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a 1073741824" returned: 0 in 0.925s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb8a62a-6414-4629-81ad-951e7e1b2d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1617045214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7577084-f45e-44b1-8798-fca41ef7a1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb1da6e08394f73bc518aab76b5b2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:02Z,use_quota=True,user_id='e985e8842b054f59bf13d7682945cf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1afc49-1b01-4289-8d32-b0de8414ad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1afc49-1b01-4289-8d32-b0de8414ad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3338af7d-7d7a-479d-bff3-057fd52d0b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3338af7d-7d7a-479d-bff3-057fd52d0b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7577084-f45e-44b1-8798-fca41ef7a1de', 'volume_name': 'volume-e7577084-f45e-44b1-8798-fca41ef7a1de', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4325bc5-bbe3-46f8-a4aa-bf8b754eab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4325bc5-bbe3-46f8-a4aa-bf8b754eab49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e1d0b0-ed88-42fc-8539-b5f23a047ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:02 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Volume e7577084-f45e-44b1-8798-fca41ef7a1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7577084-f45e-44b1-8798-fca41ef7a1de', 'volume_size': 1} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:02 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a Apr 25 02:09:02 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:02 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.700s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dc81fc-be63-4320-aa18-8eae095ba57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[68804cd0-dd32-41ed-bbba-a440d3a88259]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:03 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:03 devstack sudo[85862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d Apr 25 02:09:03 devstack sudo[85862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a" returned: 0 in 0.570s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.599s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1617045214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7577084-f45e-44b1-8798-fca41ef7a1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb1da6e08394f73bc518aab76b5b2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:02Z,use_quota=True,user_id='e985e8842b054f59bf13d7682945cf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Creating volume e7577084-f45e-44b1-8798-fca41ef7a1de {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:09:03 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:03 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de 1073741824 Apr 25 02:09:03 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Attempting download of ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}])) to volume f8655fb5-9e99-4293-8b28-6f8c8446256a. {{(pid=81927) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e24949-3724-4a04-b0c2-0388b01ad05f]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_75f3mjv2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-90f5269d-fb49-47af-bc80-d6d8cccaffe4 tempest-GroupsV314Test-226980263 None] Group tempest-GroupsV314Test-Group-1866555208: creating Apr 25 02:09:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-90f5269d-fb49-47af-bc80-d6d8cccaffe4 tempest-GroupsV314Test-226980263 None] Group tempest-GroupsV314Test-Group-1866555208: created successfully Apr 25 02:09:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-90f5269d-fb49-47af-bc80-d6d8cccaffe4 tempest-GroupsV314Test-226980263 None] Create group completed successfully. Apr 25 02:09:03 devstack sudo[85866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_75f3mjv2 Apr 25 02:09:03 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:03 devstack sudo[85862]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d" returned: 0 in 0.592s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:03 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:09:03 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:03 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_75f3mjv2" returned: 0 in 0.527s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_75f3mjv2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:03 devstack sudo[85878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_75f3mjv2 Apr 25 02:09:03 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:03 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de 1073741824" returned: 0 in 0.716s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=74,cinder:DELETE=8,cinder:SELECT=66,cinder:INSERT=17 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:09:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:03 devstack sudo[85880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de Apr 25 02:09:03 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:04 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:04 devstack sudo[85887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a Apr 25 02:09:04 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:04 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_75f3mjv2" returned: 1 in 0.602s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_75f3mjv2' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[49430045-2c4c-4b5f-abc8-85a6cd4053e6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:04 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de" returned: 0 in 0.508s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e1d0b0-ed88-42fc-8539-b5f23a047ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7577084-f45e-44b1-8798-fca41ef7a1de', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d7869f-ef25-4351-9d19-9ff05c9772c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:04 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Volume volume-e7577084-f45e-44b1-8798-fca41ef7a1de (e7577084-f45e-44b1-8798-fca41ef7a1de): created successfully Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d7869f-ef25-4351-9d19-9ff05c9772c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Flow 'volume_create_manager' (b2b1f12a-d57e-49d1-9405-43b1c718a9c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-7295b5ce-0aa0-4be7-b3af-8295cf1766b1 tempest-VolumesListAdminTestJSON-1184899302 None] Created volume successfully. Apr 25 02:09:04 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD Apr 25 02:09:04 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Flow 'volume_create_manager' (553ba7db-e714-4668-b1b4-0936f163a93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e62cf9-1ac0-4ce6-9f91-cf95eea0e287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:04 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e62cf9-1ac0-4ce6-9f91-cf95eea0e287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113640087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7938657-2552-4477-8089-96a9801e3a18,host='devstack@QuobyteHD#QuobyteHD',id=92024d69-a666-436c-92f4-d539b0744444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97ea767d6ea425ea1b5eb743d992b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:05Z,use_quota=True,user_id='eaf7d93e70f742969897fc7b95f58321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3b7ed3-9dcc-426f-bcb0-322e12c85e82),volume_type_id=6b3b7ed3-9dcc-426f-bcb0-322e12c85e82)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276e5a62-3f0d-4778-9837-446441066c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276e5a62-3f0d-4778-9837-446441066c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15452575-d200-484c-90cc-2ec87f3d7ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15452575-d200-484c-90cc-2ec87f3d7ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92024d69-a666-436c-92f4-d539b0744444', 'volume_name': 'volume-92024d69-a666-436c-92f4-d539b0744444', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a856f3c1-181c-4bbe-9e6a-f414621fe238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a856f3c1-181c-4bbe-9e6a-f414621fe238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc67eda4-127e-4dcc-b0fa-cb61e836e222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:04 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Volume 92024d69-a666-436c-92f4-d539b0744444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92024d69-a666-436c-92f4-d539b0744444', 'volume_size': 1} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c7938657-2552-4477-8089-96a9801e3a18,created_at=2026-04-25T00:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113640087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7938657-2552-4477-8089-96a9801e3a18,host='devstack@QuobyteHD#QuobyteHD',id=92024d69-a666-436c-92f4-d539b0744444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f97ea767d6ea425ea1b5eb743d992b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:05Z,use_quota=True,user_id='eaf7d93e70f742969897fc7b95f58321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b3b7ed3-9dcc-426f-bcb0-322e12c85e82),volume_type_id=6b3b7ed3-9dcc-426f-bcb0-322e12c85e82)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Creating volume 92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:09:04 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d.51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" returned: 0 in 0.764s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:04 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 1073741824 Apr 25 02:09:04 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-quobyte-51b01a61-53ed-41ec-b8c6-ece96cc6ae5a" released by "_delete_snapshot" :: held 2.774s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" released by "delete_snapshot" :: held 2.810s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Flow 'volume_create_manager' (2478fd9b-a980-4f4d-a0fe-d7cdee74573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b7447f-99f4-4515-bbe1-9b0c83702de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:05 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD" returned: 0 in 0.731s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 was qcow2, converting to raw {{(pid=81927) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b7447f-99f4-4515-bbe1-9b0c83702de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1177976349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaa3ce8-da16-4cf0-9081-f31ce2d56442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb1da6e08394f73bc518aab76b5b2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:05Z,use_quota=True,user_id='e985e8842b054f59bf13d7682945cf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:05 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a Apr 25 02:09:05 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704a8a8c-52fe-4baf-bfe7-f6ecabf57018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704a8a8c-52fe-4baf-bfe7-f6ecabf57018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaaf3e0f-7633-4095-bb26-47e2806546eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaaf3e0f-7633-4095-bb26-47e2806546eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeaa3ce8-da16-4cf0-9081-f31ce2d56442', 'volume_name': 'volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e934004-090f-46ab-91a3-cdbdfa6e359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e934004-090f-46ab-91a3-cdbdfa6e359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6cfbde-8679-44f3-b2fd-ba64f04c9909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:05 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Volume eeaa3ce8-da16-4cf0-9081-f31ce2d56442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442', 'volume_size': 1} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Created reservations ['03b426b0-6005-4f71-8ade-3bf79b64b85b', 'f512e609-a019-440b-97f6-c195957de017', '3900835a-2f0a-4e1f-943e-bd9d7afbc6fa', 'aa1c8d47-742e-475f-9fdd-0e373489ecf7'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:05 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Delete snapshot completed successfully. Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3c1ebf1c-9499-472a-a50b-35529ec0eec8 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-51b01a61-53ed-41ec-b8c6-ece96cc6ae5a-delete_snapshot" released by "delete_snapshot" :: held 3.042s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "cinder-33dc81fc-be63-4320-aa18-8eae095ba57d-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-33dc81fc-be63-4320-aa18-8eae095ba57d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:05 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 1073741824" returned: 0 in 0.754s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4eea5ca-7d2a-4012-ae6d-65758b866ecc]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:05 devstack sudo[85915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 Apr 25 02:09:05 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:05 devstack sudo[85914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d Apr 25 02:09:05 devstack sudo[85914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:06 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444" returned: 0 in 0.525s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.153s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1177976349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaa3ce8-da16-4cf0-9081-f31ce2d56442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb1da6e08394f73bc518aab76b5b2e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:05Z,use_quota=True,user_id='e985e8842b054f59bf13d7682945cf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Creating volume eeaa3ce8-da16-4cf0-9081-f31ce2d56442 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:09:06 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc67eda4-127e-4dcc-b0fa-cb61e836e222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92024d69-a666-436c-92f4-d539b0744444', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c53dac-caa2-4fe0-b979-4d2cb7644faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:06 devstack sudo[85922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 1073741824 Apr 25 02:09:06 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:06 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Volume volume-92024d69-a666-436c-92f4-d539b0744444 (92024d69-a666-436c-92f4-d539b0744444): created successfully Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c53dac-caa2-4fe0-b979-4d2cb7644faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:06 devstack sudo[85914]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Flow 'volume_create_manager' (553ba7db-e714-4668-b1b4-0936f163a93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d" returned: 0 in 0.660s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:06 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-753bd930-08c1-46f5-af32-c899f52b2283 tempest-GroupsV314Test-226980263 None] Created volume successfully. Apr 25 02:09:06 devstack sudo[85924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d Apr 25 02:09:06 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:06 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a" returned: 0 in 1.440s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_32gry443devstack@QuobyteHD, size 112.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:09:06 devstack cinder-volume[81927]: INFO cinder.image.image_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Converted 112.00 MB image at 77.71 MB/s Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:06 devstack sudo[85926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a 1G Apr 25 02:09:06 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:06 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-33dc81fc-be63-4320-aa18-8eae095ba57d" returned: 0 in 0.553s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-quobyte-33dc81fc-be63-4320-aa18-8eae095ba57d" released by "delete_volume" :: held 1.297s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:06 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Created reservations ['efe0db57-883a-4d95-9a40-516d4e52ac49', '573c6270-33a5-4792-8cff-02b4df1adffc', 'f1c3034b-8e9c-4c73-8193-26f50dc1c3c5', '5bf97370-94c3-4c12-9465-588ade583496'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:07 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 1073741824" returned: 0 in 0.809s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:07 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:09:07 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:07 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 Apr 25 02:09:07 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:07 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a 1G" returned: 0 in 0.670s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b83e76a-fc7a-4c72-b335-a321e20855f6]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:07 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a Apr 25 02:09:07 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:07 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.495s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:09:07 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Deleted volume successfully. Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3bcfddf6-fa63-42cc-a2e5-e4fcbc201ec5 tempest-SnapshotsActionsTest-1474789483 None] Lock "cinder-33dc81fc-be63-4320-aa18-8eae095ba57d-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:07 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442" returned: 0 in 0.496s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6cfbde-8679-44f3-b2fd-ba64f04c9909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b16ac20-0b0c-4db9-a8f4-c1c3fb2a3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:07 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Volume volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 (eeaa3ce8-da16-4cf0-9081-f31ce2d56442): created successfully Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b16ac20-0b0c-4db9-a8f4-c1c3fb2a3d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Flow 'volume_create_manager' (2478fd9b-a980-4f4d-a0fe-d7cdee74573e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:07 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b498d736-2377-4081-a314-3d29d0cd392e tempest-VolumesListAdminTestJSON-1184899302 None] Created volume successfully. Apr 25 02:09:07 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a" returned: 0 in 0.569s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:07 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a Apr 25 02:09:07 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:08 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Cloning volume 92024d69-a666-436c-92f4-d539b0744444 to volume 4f7cf2b2-907e-40ba-9681-c664b3e43370 Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Creating offline snapshot 74aa4aac-f168-4f1c-8d6f-8f68cdec65cd of volume 92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[084c548f-8156-44c5-973e-ccaf5b0a6e5b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:08 devstack sudo[85961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 Apr 25 02:09:08 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:08 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a" returned: 1 in 0.895s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Downloaded image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}])) to volume f8655fb5-9e99-4293-8b28-6f8c8446256a successfully. {{(pid=81927) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Temporary image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 for user 671c4999f79f4f90abc57962a434db4c is deleted. {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Marking volume f8655fb5-9e99-4293-8b28-6f8c8446256a as bootable. {{(pid=81927) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Copying metadata from image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 to f8655fb5-9e99-4293-8b28-6f8c8446256a. {{(pid=81927) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Creating volume glance metadata for volume f8655fb5-9e99-4293-8b28-6f8c8446256a backed by image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81927) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9263ed-13d8-4afd-9036-6f9254bf6be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8655fb5-9e99-4293-8b28-6f8c8446256a', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2acceb-5abf-4afa-ab81-feba05f496d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:08 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Volume volume-f8655fb5-9e99-4293-8b28-6f8c8446256a (f8655fb5-9e99-4293-8b28-6f8c8446256a): created successfully Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2acceb-5abf-4afa-ab81-feba05f496d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Flow 'volume_create_manager' (4103398d-358a-4a6d-ae4b-b791bbf63129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:08 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-c8029991-0707-42be-8c26-9bf4b0cf80e7 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Created volume successfully. Apr 25 02:09:09 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444" returned: 0 in 0.685s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:09 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd 1G Apr 25 02:09:09 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Flow 'volume_create_manager' (87882e35-e1c0-4fe4-a227-e6ee2719e586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822073df-84fc-470e-b505-7fb6016536ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (822073df-84fc-470e-b505-7fb6016536ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcab038-72b2-4473-b4bd-55910d55a5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07460b2204214e13bf73d066391614ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:09Z,use_quota=True,user_id='6aaf790c21fb4160bb5d6e1e6b853882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbd07c3-595d-4de8-bfd3-6aee8712dfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbd07c3-595d-4de8-bfd3-6aee8712dfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3862de-504a-40a4-bc0e-b267d09c621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3862de-504a-40a4-bc0e-b267d09c621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fcab038-72b2-4473-b4bd-55910d55a5ad', 'volume_name': 'volume-7fcab038-72b2-4473-b4bd-55910d55a5ad', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f04ef4-fe05-4f17-9241-1139b6ac1d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f04ef4-fe05-4f17-9241-1139b6ac1d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f755f73d-bf1b-4354-bcb0-aa8882bc7bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:09 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Volume 7fcab038-72b2-4473-b4bd-55910d55a5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fcab038-72b2-4473-b4bd-55910d55a5ad', 'volume_size': 1} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:09 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd 1G" returned: 0 in 0.772s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92024d69-a666-436c-92f4-d539b0744444 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:09 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92024d69-a666-436c-92f4-d539b0744444 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd Apr 25 02:09:09 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:10 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92024d69-a666-436c-92f4-d539b0744444 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd" returned: 0 in 0.621s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:10 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:09:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:10 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd Apr 25 02:09:10 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:10 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd" returned: 0 in 0.522s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:11 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.info Apr 25 02:09:11 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:11 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:09:11 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:11 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.info" returned: 0 in 0.581s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:11 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:11 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.info Apr 25 02:09:11 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:11 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.595s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:09:12 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.info" returned: 0 in 0.528s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Acquiring lock "cinder-quobyte-4f7cf2b2-907e-40ba-9681-c664b3e43370" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Lock "cinder-quobyte-4f7cf2b2-907e-40ba-9681-c664b3e43370" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] snapshot: 74aa4aac-f168-4f1c-8d6f-8f68cdec65cd, volume: 4f7cf2b2-907e-40ba-9681-c664b3e43370, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca67ca2-fb45-429c-89a2-621e5ab07b5b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:12 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd Apr 25 02:09:12 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:12 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd" returned: 0 in 0.555s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92024d69-a666-436c-92f4-d539b0744444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55d72f3-3a70-47b9-bea1-8e08c7d89183]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:12 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 Apr 25 02:09:12 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Flow 'volume_create_manager' (a6297679-7d18-4582-abfb-eeb1a7c5cd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88efba7-531e-4ecf-ae88-e88dbff08434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88efba7-531e-4ecf-ae88-e88dbff08434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-892749597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42204f8-fed4-49ae-ad02-3989f563c03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1509656ce164b9baf32107ab878391e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:13Z,use_quota=True,user_id='f994a40ba89d4ebcab29b9cc97c11314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657eabe4-9c4d-42e8-855c-3143184f90ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657eabe4-9c4d-42e8-855c-3143184f90ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39147f68-6923-4fb9-9043-c0b870f0db45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39147f68-6923-4fb9-9043-c0b870f0db45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42204f8-fed4-49ae-ad02-3989f563c03b', 'volume_name': 'volume-e42204f8-fed4-49ae-ad02-3989f563c03b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5724d7f-d2b2-4efd-8fb6-44c3d348f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5724d7f-d2b2-4efd-8fb6-44c3d348f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5484869a-cd53-4707-b122-3a9586a0b2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:13 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Volume e42204f8-fed4-49ae-ad02-3989f563c03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42204f8-fed4-49ae-ad02-3989f563c03b', 'volume_size': 1} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:13 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444" returned: 0 in 0.602s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:09:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:13 devstack sudo[86009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 Apr 25 02:09:13 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:18 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370" returned: 0 in 5.131s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:18 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ef63f0-7eea-49a8-a6f6-aa876386f0f5]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:18 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 Apr 25 02:09:18 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:19 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444" returned: 0 in 0.663s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:09:19 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Converted 1024.00 MB image at 199.48 MB/s Apr 25 02:09:19 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:19 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 Apr 25 02:09:19 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:19 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370" returned: 0 in 0.421s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Lock "cinder-quobyte-4f7cf2b2-907e-40ba-9681-c664b3e43370" released by "_copy_volume_from_snapshot" :: held 7.469s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Acquiring lock "cinder-quobyte-74aa4aac-f168-4f1c-8d6f-8f68cdec65cd" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Lock "cinder-quobyte-74aa4aac-f168-4f1c-8d6f-8f68cdec65cd" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Deleting offline snapshot 74aa4aac-f168-4f1c-8d6f-8f68cdec65cd of volume 92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] snapshot_file for this snap is: volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d39f94-f2a0-4455-b714-5325e250f586]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:19 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd Apr 25 02:09:19 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:20 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd" returned: 0 in 0.539s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92024d69-a666-436c-92f4-d539b0744444(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:09:20 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb70836-529e-469f-988f-9f6875add0af]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:20 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 Apr 25 02:09:20 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:20 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444" returned: 0 in 0.521s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:20 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd Apr 25 02:09:20 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:21 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd" returned: 0 in 0.545s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:21 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd Apr 25 02:09:21 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:21 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444.74aa4aac-f168-4f1c-8d6f-8f68cdec65cd" returned: 0 in 0.448s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Lock "cinder-quobyte-74aa4aac-f168-4f1c-8d6f-8f68cdec65cd" released by "_delete_snapshot" :: held 2.147s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=85,cinder:SELECT=86,cinder:DELETE=8,cinder:INSERT=18 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.564s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.640s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcab038-72b2-4473-b4bd-55910d55a5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07460b2204214e13bf73d066391614ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:09Z,use_quota=True,user_id='6aaf790c21fb4160bb5d6e1e6b853882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Creating volume 7fcab038-72b2-4473-b4bd-55910d55a5ad {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:09:21 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:09:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:21 devstack sudo[86064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad 1073741824 Apr 25 02:09:21 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-6059c050-f6a4-4315-9361-a31c2d9b14d8 tempest-GroupsV314Test-226980263 None] Create group from source-group-c7938657-2552-4477-8089-96a9801e3a18 completed successfully. Apr 25 02:09:22 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad 1073741824" returned: 0 in 0.617s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:22 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad Apr 25 02:09:22 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:22 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad" returned: 0 in 0.440s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.572s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f755f73d-bf1b-4354-bcb0-aa8882bc7bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fcab038-72b2-4473-b4bd-55910d55a5ad', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deabf6ee-e64e-4d90-a8c5-4f463760617b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd36d1-463a-454d-ae99-06f341d12c18]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:22 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Volume volume-7fcab038-72b2-4473-b4bd-55910d55a5ad (7fcab038-72b2-4473-b4bd-55910d55a5ad): created successfully Apr 25 02:09:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deabf6ee-e64e-4d90-a8c5-4f463760617b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Flow 'volume_create_manager' (87882e35-e1c0-4fe4-a227-e6ee2719e586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:23 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-15384339-d99e-4c1b-87f0-4aa7d7d5857b tempest-VolumesListAdminTestJSON-1961593441 None] Created volume successfully. Apr 25 02:09:23 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a Apr 25 02:09:23 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Acquiring lock "cinder-quobyte-4f7cf2b2-907e-40ba-9681-c664b3e43370" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Lock "cinder-quobyte-4f7cf2b2-907e-40ba-9681-c664b3e43370" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Acquiring lock "cinder-7fcab038-72b2-4473-b4bd-55910d55a5ad-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cce43b7-8217-4439-a28b-94810d5cb6a2]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Lock "cinder-7fcab038-72b2-4473-b4bd-55910d55a5ad-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Acquiring lock "cinder-quobyte-7fcab038-72b2-4473-b4bd-55910d55a5ad" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Lock "cinder-quobyte-7fcab038-72b2-4473-b4bd-55910d55a5ad" acquired by "delete_volume" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a22b39b-047a-4bd8-8cf3-dc5a123580ec]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:23 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 Apr 25 02:09:23 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:23 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a" returned: 0 in 0.580s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:23 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad Apr 25 02:09:23 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "cinder-eeaa3ce8-da16-4cf0-9081-f31ce2d56442-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:23 devstack sudo[86080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a Apr 25 02:09:23 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-eeaa3ce8-da16-4cf0-9081-f31ce2d56442-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "cinder-quobyte-eeaa3ce8-da16-4cf0-9081-f31ce2d56442" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-quobyte-eeaa3ce8-da16-4cf0-9081-f31ce2d56442" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1ac5f6-0540-4c63-a6ed-ab52fe82aeb8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:23 devstack sudo[86083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 Apr 25 02:09:23 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:24 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370" returned: 0 in 0.732s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:24 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad" returned: 0 in 0.638s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:24 devstack sudo[86094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370 Apr 25 02:09:24 devstack sudo[86094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:24 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad Apr 25 02:09:24 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:24 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a" returned: 1 in 0.670s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.293s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.111s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-892749597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42204f8-fed4-49ae-ad02-3989f563c03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1509656ce164b9baf32107ab878391e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:13Z,use_quota=True,user_id='f994a40ba89d4ebcab29b9cc97c11314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Creating volume e42204f8-fed4-49ae-ad02-3989f563c03b {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:09:24 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:24 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b 1073741824 Apr 25 02:09:24 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9', 'name': 'volume-f8655fb5-9e99-4293-8b28-6f8c8446256a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dabdfb92-2600-4319-a3a1-c91f2ec16c7e', 'enforce_multipath': True} {{(pid=81927) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 25 02:09:24 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-7fd540b6-dfa0-4697-9b23-5a9cefe48243 req-995948fe-fe61-451c-9a8c-4ed20bdd1035 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] attachment_update completed successfully. Apr 25 02:09:24 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442" returned: 0 in 0.645s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:24 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442 Apr 25 02:09:24 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:24 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7fcab038-72b2-4473-b4bd-55910d55a5ad" returned: 0 in 0.504s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Lock "cinder-quobyte-7fcab038-72b2-4473-b4bd-55910d55a5ad" released by "delete_volume" :: held 1.183s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Created reservations ['f69ca88f-2b21-4149-a92c-1b40167fd515', '04abd7f6-f4f7-46a5-9aa8-0accb7e38f5b', '5d69deaf-be2c-4ac7-b834-a7917333e3d2', 'd624023c-a18c-40ec-8a36-d38d2422a65c'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:24 devstack sudo[86094]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4f7cf2b2-907e-40ba-9681-c664b3e43370" returned: 0 in 0.612s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Lock "cinder-quobyte-4f7cf2b2-907e-40ba-9681-c664b3e43370" released by "delete_volume" :: held 1.402s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:24 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:09:24 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Created reservations ['3bac1ff3-0432-414f-b561-3529d7ac3161'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:24 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eeaa3ce8-da16-4cf0-9081-f31ce2d56442" returned: 0 in 0.549s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-quobyte-eeaa3ce8-da16-4cf0-9081-f31ce2d56442" released by "delete_volume" :: held 1.244s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:25 devstack cinder-volume[81927]: WARNING cinder.quota [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-875575710 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-875575710, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:09:25 devstack cinder-volume[81927]: WARNING cinder.quota [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-875575710 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-875575710, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Created reservations ['c5f44349-7e23-4b8b-85ac-bc6d79cb0cf1', '82e0c388-2fc3-4cbd-a713-f27c74732bec', 'c3b3bedb-47d7-4b85-87f4-68536d1ae9de', '780f9bf7-9ae3-4c97-b3c3-6c7de8295563'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Created reservations ['d82199e0-6dc2-41ac-95ec-29d08babf02e', '71c89b0c-b436-4362-9753-5e12f9925efe', '48a4b142-6d82-48f7-afd9-23c19a6c770f', 'ca8340bc-333b-4c6a-a47a-6849f5bc8548'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:25 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b 1073741824" returned: 0 in 0.843s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:25 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b Apr 25 02:09:25 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:25 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:09:25 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:25 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:09:25 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:25 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.556s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:09:25 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Deleted volume successfully. Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0c24361d-4a6b-4b12-8076-67536ed4f271 tempest-VolumesListAdminTestJSON-1961593441 None] Lock "cinder-7fcab038-72b2-4473-b4bd-55910d55a5ad-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:25 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b" returned: 0 in 0.632s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:25 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5484869a-cd53-4707-b122-3a9586a0b2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42204f8-fed4-49ae-ad02-3989f563c03b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187eb8a6-f6e6-40a5-9788-0672122e3682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.602s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:09:25 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Deleted volume successfully. Apr 25 02:09:25 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Volume volume-e42204f8-fed4-49ae-ad02-3989f563c03b (e42204f8-fed4-49ae-ad02-3989f563c03b): created successfully Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187eb8a6-f6e6-40a5-9788-0672122e3682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Flow 'volume_create_manager' (a6297679-7d18-4582-abfb-eeb1a7c5cd7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:25 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:25 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-6bdfedb6-7472-41ab-9fc8-aa50d2718059 tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Created volume successfully. Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.555s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:09:25 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bdf2644a-e424-4e39-803b-d9f08fd97259 tempest-GroupsV314Test-226980263 None] Delete group completed successfully. Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c2155e36-ecc7-48d1-8a87-a2a501610fde tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-eeaa3ce8-da16-4cf0-9081-f31ce2d56442-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Acquiring lock "cinder-quobyte-92024d69-a666-436c-92f4-d539b0744444" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Lock "cinder-quobyte-92024d69-a666-436c-92f4-d539b0744444" acquired by "delete_volume" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "cinder-e7577084-f45e-44b1-8798-fca41ef7a1de-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbb0d8e-2950-454e-ae85-d7c1b14ae05b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-e7577084-f45e-44b1-8798-fca41ef7a1de-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "cinder-quobyte-e7577084-f45e-44b1-8798-fca41ef7a1de" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-quobyte-e7577084-f45e-44b1-8798-fca41ef7a1de" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:26 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 Apr 25 02:09:26 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f4ba1-2992-4af2-be75-8dcf211628b9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:26 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de Apr 25 02:09:26 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:26 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444" returned: 0 in 0.631s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:26 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444 Apr 25 02:09:26 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:26 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de" returned: 0 in 0.606s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:26 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de Apr 25 02:09:26 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:27 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-92024d69-a666-436c-92f4-d539b0744444" returned: 0 in 0.537s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Lock "cinder-quobyte-92024d69-a666-436c-92f4-d539b0744444" released by "delete_volume" :: held 1.259s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Acquiring lock "cinder-e42204f8-fed4-49ae-ad02-3989f563c03b-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "cinder-e42204f8-fed4-49ae-ad02-3989f563c03b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Created reservations ['345aed06-47ef-40f9-8dfe-1d91a4f72117'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Acquiring lock "cinder-quobyte-e42204f8-fed4-49ae-ad02-3989f563c03b" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:27 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e7577084-f45e-44b1-8798-fca41ef7a1de" returned: 0 in 0.549s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "cinder-quobyte-e42204f8-fed4-49ae-ad02-3989f563c03b" acquired by "delete_volume" :: waited 0.032s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-quobyte-e7577084-f45e-44b1-8798-fca41ef7a1de" released by "delete_volume" :: held 1.223s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8af59a0-971e-496e-949d-b9c3087014df]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Created reservations ['eaa25b63-8042-4786-9624-d3c2524b19ca', '5ca87027-f121-4d4e-a0bb-493c7add34c8', '86c70942-ce86-44fa-9b88-0c13ef79a572', '422e84b9-fa12-4435-8d93-2bed5918a62b'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Created reservations ['748ee432-7b93-42d4-96c5-0d5ad053d30c', 'cc1f6473-4f3a-4834-af0b-b5c3d0e4c01d', '42d1a88d-3dfe-40ba-8f14-e13ae2746f2f', '9b624a31-38d3-452a-bfb6-a290ca94b450'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:27 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b Apr 25 02:09:27 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:27 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:09:27 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:27 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:09:27 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:27 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b" returned: 0 in 0.549s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:28 devstack sudo[86186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b Apr 25 02:09:28 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:28 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.530s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:09:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Deleted volume successfully. Apr 25 02:09:28 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.478s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69f81f49-fae0-4869-9664-dbb21fe2da67 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-e7577084-f45e-44b1-8798-fca41ef7a1de-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-39f017c7-2261-4a99-bbf6-acba95528bde tempest-GroupsV314Test-226980263 None] Delete group completed successfully. Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "cinder-480c0fa7-7bd0-4761-bc34-612d882f83f2-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-480c0fa7-7bd0-4761-bc34-612d882f83f2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "cinder-quobyte-480c0fa7-7bd0-4761-bc34-612d882f83f2" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-quobyte-480c0fa7-7bd0-4761-bc34-612d882f83f2" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[39049540-a357-4496-8f29-80d5f56f4e42]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:28 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e42204f8-fed4-49ae-ad02-3989f563c03b" returned: 0 in 0.559s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "cinder-quobyte-e42204f8-fed4-49ae-ad02-3989f563c03b" released by "delete_volume" :: held 1.153s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Created reservations ['7873fc91-a660-4e4e-8d59-ec658d4eacbe', 'd6d39320-96f7-46ea-9d82-4eae7a72211d', '332e3f06-d0de-4014-8f93-3525bad8fdf4', '9ffbea41-95cf-41fb-9536-83167f6494e4'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:28 devstack sudo[86191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 Apr 25 02:09:28 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:28 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:09:28 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:29 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2" returned: 0 in 0.641s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:29 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2 Apr 25 02:09:29 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:29 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.553s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:09:29 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Deleted volume successfully. Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-635637f3-47c2-4f9a-b839-02e8e050e6ef tempest-VolumeQuotasNegativeTestJSON-1729569205 None] Lock "cinder-e42204f8-fed4-49ae-ad02-3989f563c03b-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:29 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-480c0fa7-7bd0-4761-bc34-612d882f83f2" returned: 0 in 0.644s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-quobyte-480c0fa7-7bd0-4761-bc34-612d882f83f2" released by "delete_volume" :: held 1.334s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Created reservations ['a82d3708-8bea-419b-86a4-fb290fa99ffd', '50d87c6a-4e91-4de4-8f40-7fbf49fb0df9', 'ab672898-2eb4-4e9c-ba4f-d874ebfb5b29', '05aea529-36cc-4e5b-8412-13236ac06c72'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:30 devstack sudo[86213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:09:30 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:31 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.023s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:31 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:09:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Deleted volume successfully. Apr 25 02:09:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c839641-03b8-4e03-ab7c-78d4a7c5bc56 tempest-VolumesListAdminTestJSON-1184899302 None] Lock "cinder-480c0fa7-7bd0-4761-bc34-612d882f83f2-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:09:39 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=57,cinder:UPDATE=66,cinder:INSERT=18,cinder:DELETE=2 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:09:41 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=101,cinder:SELECT=82,cinder:INSERT=35,cinder:DELETE=5 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Flow 'volume_create_manager' (7c36e924-42f6-4770-ac80-dafa742bcf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf3c3ea-2b55-4095-9465-9e6e594523b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf3c3ea-2b55-4095-9465-9e6e594523b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1968796343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2778bb8c-9cc2-448e-9395-2fffe0f5358d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8635e9cdd6429c94f234168a4115dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:42Z,use_quota=True,user_id='07b21c3fc37d426eb6da408c7a1c2118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cae27a9-2611-4473-8df2-de2ed320bbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cae27a9-2611-4473-8df2-de2ed320bbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78353353-b205-4c94-ab39-79d3bc2a99dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78353353-b205-4c94-ab39-79d3bc2a99dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2778bb8c-9cc2-448e-9395-2fffe0f5358d', 'volume_name': 'volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f6a5f2-342a-4e5b-8593-7fad2a407470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f6a5f2-342a-4e5b-8593-7fad2a407470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558afe75-7459-484b-8869-c1ae591f5f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:42 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Volume 2778bb8c-9cc2-448e-9395-2fffe0f5358d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d', 'volume_size': 1} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1968796343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2778bb8c-9cc2-448e-9395-2fffe0f5358d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8635e9cdd6429c94f234168a4115dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:42Z,use_quota=True,user_id='07b21c3fc37d426eb6da408c7a1c2118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Creating volume 2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:09:42 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:09:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:42 devstack sudo[86281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d 1073741824 Apr 25 02:09:42 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:43 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d 1073741824" returned: 0 in 0.847s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:43 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d Apr 25 02:09:43 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:43 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d" returned: 0 in 0.525s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:43 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:09:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558afe75-7459-484b-8869-c1ae591f5f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc666f73-5cd8-4ff0-8c73-d1de18f4b53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:43 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Volume volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d (2778bb8c-9cc2-448e-9395-2fffe0f5358d): created successfully Apr 25 02:09:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc666f73-5cd8-4ff0-8c73-d1de18f4b53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Flow 'volume_create_manager' (7c36e924-42f6-4770-ac80-dafa742bcf69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:43 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dee1d75f-f8ed-4215-8e19-9a46dc612935 tempest-VolumesCloneTest-664750922 None] Created volume successfully. Apr 25 02:09:44 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:09:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Flow 'volume_create_manager' (c4e0562a-a724-4daa-bda8-f7dbab5a322b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b3984e-0445-4158-a2ae-2e70f8483abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b3984e-0445-4158-a2ae-2e70f8483abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1324643088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8635e9cdd6429c94f234168a4115dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2778bb8c-9cc2-448e-9395-2fffe0f5358d,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:45Z,use_quota=True,user_id='07b21c3fc37d426eb6da408c7a1c2118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556b8ccf-8823-43cf-ac32-cbdb61ce2355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556b8ccf-8823-43cf-ac32-cbdb61ce2355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fd3307-5633-4364-8541-8217964de041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fd3307-5633-4364-8541-8217964de041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22', 'volume_name': 'volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22', 'volume_size': 2, 'source_volid': '2778bb8c-9cc2-448e-9395-2fffe0f5358d', 'source_volstatus': 'available'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb32b1e2-d9b3-403c-9730-123eaa8e8f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb32b1e2-d9b3-403c-9730-123eaa8e8f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613985ea-f4e6-4c80-8df3-5b96e34adb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:45 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Volume f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22', 'volume_size': 2, 'source_volid': '2778bb8c-9cc2-448e-9395-2fffe0f5358d', 'source_volstatus': 'available'} Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:45 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Cloning volume 2778bb8c-9cc2-448e-9395-2fffe0f5358d to volume f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Creating offline snapshot eae93a52-ae71-46f5-a363-3c87f42744d8 of volume 2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc48da9e-4395-4f87-9230-5ce31c75b7d3]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:45 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d Apr 25 02:09:45 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:45 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d" returned: 0 in 0.656s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:45 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 1G Apr 25 02:09:45 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:46 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 1G" returned: 0 in 0.875s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:46 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 Apr 25 02:09:46 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:47 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8" returned: 0 in 0.685s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:47 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 is being set with open permissions: ugo+rw Apr 25 02:09:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:47 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 Apr 25 02:09:47 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:47 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8" returned: 0 in 0.636s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:48 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.info Apr 25 02:09:48 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:48 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.info" returned: 0 in 0.602s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:48 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.info is being set with open permissions: ugo+rw Apr 25 02:09:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:48 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.info Apr 25 02:09:48 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:49 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.info" returned: 0 in 0.647s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Acquiring lock "cinder-quobyte-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Lock "cinder-quobyte-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] snapshot: eae93a52-ae71-46f5-a363-3c87f42744d8, volume: f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4a8d68-0860-4a83-b1b6-98bfee97cfd2]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:49 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 Apr 25 02:09:49 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:50 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8" returned: 0 in 1.208s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:09:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:09:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:09:50 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[56522b04-734f-47fa-ba2f-0c5e65679a5a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:50 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d Apr 25 02:09:50 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Flow 'volume_create_manager' (284c106c-1e76-4154-897a-2df1cdea237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ce171f-833d-4524-82dc-489802c57a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ce171f-833d-4524-82dc-489802c57a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1118800205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62353127-4830-4386-abaa-e66457933f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cccc7b776242f699e23579433462ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:51Z,use_quota=True,user_id='102ed20d9f62479089ef9ef9cfb29360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7926d743-d3ab-4aff-a49b-5bbe070c6170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7926d743-d3ab-4aff-a49b-5bbe070c6170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032ce817-1076-4880-8349-b3e0706bea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032ce817-1076-4880-8349-b3e0706bea4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62353127-4830-4386-abaa-e66457933f40', 'volume_name': 'volume-62353127-4830-4386-abaa-e66457933f40', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b135412f-ec38-4d57-9538-7d1e2da29e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b135412f-ec38-4d57-9538-7d1e2da29e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a356132c-3da6-4f47-8b7d-9087c5a804f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Volume 62353127-4830-4386-abaa-e66457933f40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62353127-4830-4386-abaa-e66457933f40', 'volume_size': 1} Apr 25 02:09:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:52 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d" returned: 0 in 1.477s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:52 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:09:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:52 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 Apr 25 02:09:52 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Flow 'volume_create_manager' (eea8b393-d4e8-4644-9f7d-9e2655dd15ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c191b090-7543-41d1-bfae-323fa635faee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c191b090-7543-41d1-bfae-323fa635faee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1768449500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d24e52-1fb5-49f0-8301-1b25ad08e1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3841413b1c4e6c855ca7ca2e76cb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:53Z,use_quota=True,user_id='69b509182b8149589293125ae10bd54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e55209-4f14-4dbe-93af-2f7e002baf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e55209-4f14-4dbe-93af-2f7e002baf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87424ae2-17ca-4de5-9083-06783078254c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87424ae2-17ca-4de5-9083-06783078254c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d24e52-1fb5-49f0-8301-1b25ad08e1eb', 'volume_name': 'volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a669dc7e-8496-4fd1-a077-56f7bbaa943d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a669dc7e-8496-4fd1-a077-56f7bbaa943d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aaac5a5-2e86-4f98-9e00-6ac289b54543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:09:53 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Volume 99d24e52-1fb5-49f0-8301-1b25ad08e1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb', 'volume_size': 1} Apr 25 02:09:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:09:59 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Apr 25 02:09:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" returned: 0 in 7.313s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:09:59 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50e2e39-5256-49a6-ba39-7a0a2b368b53]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:09:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:09:59 devstack sudo[86486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d Apr 25 02:09:59 devstack sudo[86486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:00 devstack sudo[86486]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d" returned: 0 in 0.814s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d, size 1024.00 MB, duration 7.31 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:10:00 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Converted 1024.00 MB image at 140.00 MB/s Apr 25 02:10:00 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 is being set with open permissions: ugo+rw Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:00 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 Apr 25 02:10:00 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:00 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" returned: 0 in 0.523s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Lock "cinder-quobyte-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" released by "_copy_volume_from_snapshot" :: held 11.482s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Acquiring lock "cinder-quobyte-eae93a52-ae71-46f5-a363-3c87f42744d8" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Lock "cinder-quobyte-eae93a52-ae71-46f5-a363-3c87f42744d8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Deleting offline snapshot eae93a52-ae71-46f5-a363-3c87f42744d8 of volume 2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] snapshot_file for this snap is: volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1d99b9-bef3-4dfb-ab42-d8eba3eed389]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:00 devstack sudo[86496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 Apr 25 02:10:00 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:01 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8" returned: 0 in 0.653s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:10:01 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0107d3-8e49-41cb-830a-d44070ee2024]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:01 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d Apr 25 02:10:01 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:02 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d" returned: 0 in 0.639s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:02 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 Apr 25 02:10:02 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:02 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8" returned: 0 in 0.628s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:02 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8 Apr 25 02:10:02 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:10:03 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d.eae93a52-ae71-46f5-a363-3c87f42744d8" returned: 0 in 0.500s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Lock "cinder-quobyte-eae93a52-ae71-46f5-a363-3c87f42744d8" released by "_delete_snapshot" :: held 2.560s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.392s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.242s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1118800205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62353127-4830-4386-abaa-e66457933f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cccc7b776242f699e23579433462ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:51Z,use_quota=True,user_id='102ed20d9f62479089ef9ef9cfb29360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Creating volume 62353127-4830-4386-abaa-e66457933f40 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:03 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:03 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 1073741824 Apr 25 02:10:03 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613985ea-f4e6-4c80-8df3-5b96e34adb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22', 'volume_size': 2, 'source_volid': '2778bb8c-9cc2-448e-9395-2fffe0f5358d', 'source_volstatus': 'available'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84a7aa4-bfd9-4ba9-a070-c65a2a2f6e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:03 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Volume volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 (f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22): created successfully Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84a7aa4-bfd9-4ba9-a070-c65a2a2f6e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Flow 'volume_create_manager' (c4e0562a-a724-4daa-bda8-f7dbab5a322b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-29d2ea82-f2b9-47e6-9968-376b1c75db6b tempest-VolumesCloneTest-664750922 None] Created volume successfully. Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Acquiring lock "cinder-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Lock "cinder-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Acquiring lock "cinder-quobyte-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Lock "cinder-quobyte-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aff5a9b-19ca-46c4-8dfd-30e89b99d12f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:03 devstack sudo[86554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 Apr 25 02:10:03 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:04 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 1073741824" returned: 0 in 0.729s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:04 devstack sudo[86562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 Apr 25 02:10:04 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:04 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" returned: 0 in 0.656s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-069747fb-4c79-4593-9168-faeb4228f324 req-f450c4fc-5fb2-4f46-8031-6347c698bb4d tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Terminate volume connection completed successfully. Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-069747fb-4c79-4593-9168-faeb4228f324 req-f450c4fc-5fb2-4f46-8031-6347c698bb4d tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Deleting attachment dabdfb92-2600-4319-a3a1-c91f2ec16c7e. {{(pid=81927) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 25 02:10:04 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22 Apr 25 02:10:04 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:04 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40" returned: 0 in 0.538s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.465s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1768449500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d24e52-1fb5-49f0-8301-1b25ad08e1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3841413b1c4e6c855ca7ca2e76cb9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:09:53Z,use_quota=True,user_id='69b509182b8149589293125ae10bd54b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Creating volume 99d24e52-1fb5-49f0-8301-1b25ad08e1eb {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:04 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:04 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb 1073741824 Apr 25 02:10:04 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a356132c-3da6-4f47-8b7d-9087c5a804f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62353127-4830-4386-abaa-e66457933f40', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37162ada-5db8-4384-8f36-db550307f3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:04 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Volume volume-62353127-4830-4386-abaa-e66457933f40 (62353127-4830-4386-abaa-e66457933f40): created successfully Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37162ada-5db8-4384-8f36-db550307f3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Flow 'volume_create_manager' (284c106c-1e76-4154-897a-2df1cdea237b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ef968977-94ed-46e3-8e29-e235eaaf82c8 tempest-SnapshotMetadataTestJSON-1429760032 None] Created volume successfully. Apr 25 02:10:05 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" returned: 0 in 0.501s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Lock "cinder-quobyte-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22" released by "delete_volume" :: held 1.209s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Created reservations ['3a434805-c6f0-4a34-863e-f00995efe89f', 'f481f251-c6fe-40ab-b7ec-c5fae9c8a5b3', '8076c2ed-12c4-4030-8866-7d35fc64e4cc', '6020a635-7c4d-44b3-a9e5-c387f1fac984'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "cinder-f8655fb5-9e99-4293-8b28-6f8c8446256a-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:05 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:05 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "cinder-f8655fb5-9e99-4293-8b28-6f8c8446256a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "cinder-quobyte-f8655fb5-9e99-4293-8b28-6f8c8446256a" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "cinder-quobyte-f8655fb5-9e99-4293-8b28-6f8c8446256a" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3fb7a6-4f25-4242-8867-e468820bb508]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:05 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a Apr 25 02:10:05 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:05 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb 1073741824" returned: 0 in 0.810s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:05 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb Apr 25 02:10:05 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:05 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.666s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:05 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Deleted volume successfully. Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0766d1d2-8bdc-405e-b10f-b9d81f9fdd76 tempest-VolumesCloneTest-664750922 None] Lock "cinder-f7ce6ad2-1dbb-4ce1-8db2-f3f01399ec22-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:06 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a" returned: 0 in 0.740s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Acquiring lock "cinder-2778bb8c-9cc2-448e-9395-2fffe0f5358d-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Lock "cinder-2778bb8c-9cc2-448e-9395-2fffe0f5358d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Acquiring lock "cinder-quobyte-2778bb8c-9cc2-448e-9395-2fffe0f5358d" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:06 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a Apr 25 02:10:06 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Lock "cinder-quobyte-2778bb8c-9cc2-448e-9395-2fffe0f5358d" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a0152d-5d0b-4317-8f6a-097bd4af20b5]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:06 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb" returned: 0 in 0.617s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.270s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aaac5a5-2e86-4f98-9e00-6ac289b54543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1275ecdc-a46e-470c-adf3-6e61c028f6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Creating offline snapshot 713aab10-c089-4be8-adfc-f8894ecf416e of volume 62353127-4830-4386-abaa-e66457933f40 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:10:06 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Volume volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb (99d24e52-1fb5-49f0-8301-1b25ad08e1eb): created successfully Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1275ecdc-a46e-470c-adf3-6e61c028f6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Flow 'volume_create_manager' (eea8b393-d4e8-4644-9f7d-9e2655dd15ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[357d5602-83e1-40f6-af65-a0373e8d09ed]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:06 devstack sudo[86595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d Apr 25 02:10:06 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:06 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c1d4b8b0-ffce-4f3b-ae50-3fb5a9ebe3e2 tempest-VolumesServicesTestJSON-1320009972 None] Created volume successfully. Apr 25 02:10:06 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 Apr 25 02:10:06 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:06 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a" returned: 1 in 0.569s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:06 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a Apr 25 02:10:06 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:06 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d" returned: 0 in 0.628s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:06 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d Apr 25 02:10:06 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:06 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40" returned: 0 in 0.612s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:06 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e 1G Apr 25 02:10:06 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:07 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f8655fb5-9e99-4293-8b28-6f8c8446256a" returned: 0 in 0.565s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "cinder-quobyte-f8655fb5-9e99-4293-8b28-6f8c8446256a" released by "delete_volume" :: held 1.944s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.quota [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Created reservations ['6ec9bb02-2347-42b8-a211-1041badb7b69', 'a8779b6c-e7fe-4b94-a7ab-a3996c2d452a', '1947413b-7eb5-459a-a5d7-eb6de5c52868', '716f0da1-b2bf-4838-8dbe-ec175dfce0b3'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:07 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:07 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:07 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-2778bb8c-9cc2-448e-9395-2fffe0f5358d" returned: 0 in 0.557s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Lock "cinder-quobyte-2778bb8c-9cc2-448e-9395-2fffe0f5358d" released by "delete_volume" :: held 1.245s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Created reservations ['115ba4e5-09d1-486e-bd8e-b87db4f6bf17', 'a8477ff4-817f-4609-a411-47ebf51ea0d7', 'cbf87e21-7a65-4d15-a3f2-1955c490fb80', 'af22a234-e8a4-4451-9941-a7e56c651857'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Acquiring lock "cinder-99d24e52-1fb5-49f0-8301-1b25ad08e1eb-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:07 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:07 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Lock "cinder-99d24e52-1fb5-49f0-8301-1b25ad08e1eb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Acquiring lock "cinder-quobyte-99d24e52-1fb5-49f0-8301-1b25ad08e1eb" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Lock "cinder-quobyte-99d24e52-1fb5-49f0-8301-1b25ad08e1eb" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b93977d-ec63-4f0d-8d3e-875a379e84ee]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:07 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e 1G" returned: 0 in 0.826s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62353127-4830-4386-abaa-e66457933f40 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:07 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62353127-4830-4386-abaa-e66457933f40 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e Apr 25 02:10:07 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:07 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb Apr 25 02:10:07 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:07 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.634s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG cinder.manager [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:08 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Deleted volume successfully. Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-069747fb-4c79-4593-9168-faeb4228f324 req-b774ae14-5bbe-433d-9738-456a3733289c tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "cinder-f8655fb5-9e99-4293-8b28-6f8c8446256a-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:08 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:08 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Deleted volume successfully. Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e729f19-20c5-4582-8aeb-9ead88da2a3b tempest-VolumesCloneTest-664750922 None] Lock "cinder-2778bb8c-9cc2-448e-9395-2fffe0f5358d-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:08 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62353127-4830-4386-abaa-e66457933f40 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e" returned: 0 in 0.585s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:08 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e is being set with open permissions: ugo+rw Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:08 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb" returned: 0 in 0.679s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:08 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e Apr 25 02:10:08 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:08 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb Apr 25 02:10:08 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:08 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e" returned: 0 in 0.530s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:08 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-99d24e52-1fb5-49f0-8301-1b25ad08e1eb" returned: 0 in 0.532s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Lock "cinder-quobyte-99d24e52-1fb5-49f0-8301-1b25ad08e1eb" released by "delete_volume" :: held 1.260s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:09 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.info Apr 25 02:10:09 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Created reservations ['8e01e8a4-ff59-48e0-843c-9a25e72f4234', '5c051239-0504-4013-97ed-e87f8a511331', '6bed551a-a0cf-40c3-832c-dc92378cc5d8', '5fae85dd-7003-4c85-b548-6f7bc8c171c1'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:09 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:09 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:09 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.info" returned: 0 in 0.651s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:09 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.info is being set with open permissions: ugo+rw Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:09 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.info Apr 25 02:10:09 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:09 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.709s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:09 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Deleted volume successfully. Apr 25 02:10:09 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7a195ccc-5ae1-466a-ab75-81a44418a617 tempest-VolumesServicesTestJSON-1320009972 None] Lock "cinder-99d24e52-1fb5-49f0-8301-1b25ad08e1eb-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:10 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.info" returned: 0 in 0.535s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.910s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:10 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0e4528fb-5011-4bd0-b928-74a221c8efaf tempest-SnapshotMetadataTestJSON-1429760032 None] Create snapshot completed successfully Apr 25 02:10:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:10:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:11 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:11 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:11 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.862s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Flow 'volume_create_manager' (7706f5d0-4ce4-40dd-8113-b6a88b6d519e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a24bbae-7efc-4ec8-a61e-fc4dacff9052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Acquiring lock "cinder-713aab10-c089-4be8-adfc-f8894ecf416e-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a24bbae-7efc-4ec8-a61e-fc4dacff9052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-468217561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4193fe-0295-4dc2-b80a-aa671b36c938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a8f60584746c48d347a3bdfe6a03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:12Z,use_quota=True,user_id='cc2a4f98eaff4ef1b45c185c96092d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470cc29d-1e4a-418e-8db5-339ec5510f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470cc29d-1e4a-418e-8db5-339ec5510f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73482d38-2e29-4dad-97ae-873e5499c571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.image.glance [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Creating Keystone auth plugin from conf {{(pid=81927) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-713aab10-c089-4be8-adfc-f8894ecf416e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Acquiring lock "cinder-quobyte-62353127-4830-4386-abaa-e66457933f40" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-quobyte-62353127-4830-4386-abaa-e66457933f40" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Acquiring lock "cinder-quobyte-713aab10-c089-4be8-adfc-f8894ecf416e" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-quobyte-713aab10-c089-4be8-adfc-f8894ecf416e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Deleting offline snapshot 713aab10-c089-4be8-adfc-f8894ecf416e of volume 62353127-4830-4386-abaa-e66457933f40 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] snapshot_file for this snap is: volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf1d459-1f6e-4564-863f-4ab9130eb5cf]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:12 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e Apr 25 02:10:12 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73482d38-2e29-4dad-97ae-873e5499c571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb4193fe-0295-4dc2-b80a-aa671b36c938', 'volume_name': 'volume-eb4193fe-0295-4dc2-b80a-aa671b36c938', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdfcf7b-998c-4358-a76a-11646f20a9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bdfcf7b-998c-4358-a76a-11646f20a9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c041896-4374-4800-902a-6befa779c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:12 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Volume eb4193fe-0295-4dc2-b80a-aa671b36c938: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb4193fe-0295-4dc2-b80a-aa671b36c938', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 25 02:10:12 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Trying to clone eb4193fe-0295-4dc2-b80a-aa671b36c938 from image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]). {{(pid=81927) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 25 02:10:13 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Image download 20.69 MB at 20.69 MB/s Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[affb135a-2490-4917-b722-e3f27851fa47]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:13 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e" returned: 0 in 0.860s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62353127-4830-4386-abaa-e66457933f40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:10:13 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD Apr 25 02:10:13 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd719ab-ff78-45c8-86f4-b51cc3266770]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:13 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 Apr 25 02:10:13 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:13 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Temporary image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 is fetched for user cc2a4f98eaff4ef1b45c185c96092d57. {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0655d1bf-5dad-4bb8-9326-c744eb3f435b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:13 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40" returned: 0 in 0.659s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:14 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e Apr 25 02:10:14 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:14 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD Apr 25 02:10:14 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:14 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-468217561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4193fe-0295-4dc2-b80a-aa671b36c938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a8f60584746c48d347a3bdfe6a03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:12Z,use_quota=True,user_id='cc2a4f98eaff4ef1b45c185c96092d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Creating volume eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:14 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:14 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e" returned: 0 in 0.602s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:14 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 1073741824 Apr 25 02:10:14 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:14 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e Apr 25 02:10:14 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:15 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40.713aab10-c089-4be8-adfc-f8894ecf416e" returned: 0 in 0.554s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-quobyte-713aab10-c089-4be8-adfc-f8894ecf416e" released by "_delete_snapshot" :: held 2.824s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-quobyte-62353127-4830-4386-abaa-e66457933f40" released by "delete_snapshot" :: held 2.860s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Created reservations ['14af5a92-6acc-425d-9804-f48c0aa1a923', '0c3b3af4-ae48-4be7-a45c-7fe934603362', '1bf1ad5d-1195-4613-8046-6a030ce97c64', 'a8703f1e-97d6-4ba8-ad1b-eeec5590dfda'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:15 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 1073741824" returned: 0 in 0.752s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:15 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 Apr 25 02:10:15 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:15 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Delete snapshot completed successfully. Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8d09564-2703-4c09-ac9e-b9d91202170d tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-713aab10-c089-4be8-adfc-f8894ecf416e-delete_snapshot" released by "delete_snapshot" :: held 3.123s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Acquiring lock "cinder-62353127-4830-4386-abaa-e66457933f40-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-62353127-4830-4386-abaa-e66457933f40-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Acquiring lock "cinder-quobyte-62353127-4830-4386-abaa-e66457933f40" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-quobyte-62353127-4830-4386-abaa-e66457933f40" acquired by "delete_volume" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[11beeeb7-126f-4b18-bcaa-7708ccaf9b06]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:15 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 Apr 25 02:10:15 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:15 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938" returned: 0 in 0.573s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:15 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Attempting download of ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}])) to volume eb4193fe-0295-4dc2-b80a-aa671b36c938. {{(pid=81927) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a462bbc7-dd24-4112-964d-2b9a069babc3]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_xwc7h5oa {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:16 devstack sudo[86724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_xwc7h5oa Apr 25 02:10:16 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:16 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40" returned: 0 in 0.634s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:16 devstack sudo[86729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40 Apr 25 02:10:16 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:16 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Flow 'volume_create_manager' (66e22eb1-bb75-4654-a224-945f03d260f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee70ffa1-0c61-49d6-8030-c0711bd54e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_xwc7h5oa" returned: 0 in 0.753s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_xwc7h5oa {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee70ffa1-0c61-49d6-8030-c0711bd54e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1852388645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20649a0c-66fd-4315-adf5-6c7c2af1ee2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa7443b00b9427792e82fd711a80a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:17Z,use_quota=True,user_id='3d64abab469d48d7956019c688cd0d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132d3e04-f6ed-4e9b-a566-02eeebb28eac),volume_type_id=132d3e04-f6ed-4e9b-a566-02eeebb28eac)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335a4ea8-b422-46a0-865b-7b725a727d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335a4ea8-b422-46a0-865b-7b725a727d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f95053-cdbe-4bbd-951b-b73eca555ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f95053-cdbe-4bbd-951b-b73eca555ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20649a0c-66fd-4315-adf5-6c7c2af1ee2d', 'volume_name': 'volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbea80a-6b50-4f83-a385-4540441e5989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbea80a-6b50-4f83-a385-4540441e5989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9d7604-9ce5-4f16-9faf-576661f390df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:16 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Volume 20649a0c-66fd-4315-adf5-6c7c2af1ee2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d', 'volume_size': 1} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1852388645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20649a0c-66fd-4315-adf5-6c7c2af1ee2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa7443b00b9427792e82fd711a80a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:17Z,use_quota=True,user_id='3d64abab469d48d7956019c688cd0d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(132d3e04-f6ed-4e9b-a566-02eeebb28eac),volume_type_id=132d3e04-f6ed-4e9b-a566-02eeebb28eac)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Creating volume 20649a0c-66fd-4315-adf5-6c7c2af1ee2d {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:16 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:16 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_xwc7h5oa Apr 25 02:10:16 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:16 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d 1073741824 Apr 25 02:10:16 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:16 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62353127-4830-4386-abaa-e66457933f40" returned: 0 in 0.620s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-quobyte-62353127-4830-4386-abaa-e66457933f40" released by "delete_volume" :: held 1.318s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:16 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Created reservations ['60065c61-93fc-4f60-b370-3824c544918f', 'ba61b436-260a-4bab-a7f6-a8ef54b595d2', 'fcb9266b-ecbe-4a41-aad2-6531a26ca636', '1e2e9f1f-ada8-4705-a6c5-61c125803b70'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:17 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:17 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:17 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_xwc7h5oa" returned: 1 in 0.651s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_xwc7h5oa' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[59920c81-3a11-4b80-9239-9c07dc996a64]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:17 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d 1073741824" returned: 0 in 0.675s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:17 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD Apr 25 02:10:17 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:17 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.545s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:17 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Deleted volume successfully. Apr 25 02:10:17 devstack sudo[86750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d Apr 25 02:10:17 devstack sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ccc9274a-2235-4bef-b4c8-16044cdc4bfa tempest-SnapshotMetadataTestJSON-1429760032 None] Lock "cinder-62353127-4830-4386-abaa-e66457933f40-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:18 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 was qcow2, converting to raw {{(pid=81927) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:18 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 Apr 25 02:10:18 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:18 devstack sudo[86750]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d" returned: 0 in 0.837s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a9d7604-9ce5-4f16-9faf-576661f390df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531e42bc-7381-471e-b322-a86dbc52c80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:18 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Volume volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d (20649a0c-66fd-4315-adf5-6c7c2af1ee2d): created successfully Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531e42bc-7381-471e-b322-a86dbc52c80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Flow 'volume_create_manager' (66e22eb1-bb75-4654-a224-945f03d260f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:18 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3592ac4c-086b-4693-a3e9-a4974b2b558f tempest-VolumeTypesAccessTest-677569260 None] Created volume successfully. Apr 25 02:10:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Acquiring lock "cinder-20649a0c-66fd-4315-adf5-6c7c2af1ee2d-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Lock "cinder-20649a0c-66fd-4315-adf5-6c7c2af1ee2d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Acquiring lock "cinder-quobyte-20649a0c-66fd-4315-adf5-6c7c2af1ee2d" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Lock "cinder-quobyte-20649a0c-66fd-4315-adf5-6c7c2af1ee2d" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:19 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e47fbb9-dd57-4849-8e52-5d668d03841f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:19 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d Apr 25 02:10:19 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:19 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d" returned: 0 in 0.816s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:20 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d Apr 25 02:10:20 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:20 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938" returned: 0 in 1.928s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_avc9l48cdevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:10:20 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Converted 112.00 MB image at 58.05 MB/s Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:20 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 1G Apr 25 02:10:20 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:20 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20649a0c-66fd-4315-adf5-6c7c2af1ee2d" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Lock "cinder-quobyte-20649a0c-66fd-4315-adf5-6c7c2af1ee2d" released by "delete_volume" :: held 1.449s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:20 devstack cinder-volume[81927]: WARNING cinder.quota [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1930568114 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1930568114, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:10:20 devstack cinder-volume[81927]: WARNING cinder.quota [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1930568114 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1930568114, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Created reservations ['376b1546-a08c-4540-8b16-8af7910c2f71', '43fc050a-a8a7-426b-8ead-a60da7b2a45f', 'eccfea9a-f2cf-49be-ab89-b4083011dd46', '50e3e338-009e-49f7-bfe0-9729a89c6684'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:20 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 1G" returned: 0 in 0.590s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:20 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:20 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7645ac98-4850-4e93-b550-3fa72589cfc0]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:20 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 Apr 25 02:10:20 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Flow 'volume_create_manager' (d8061466-fde8-4685-aace-9752e98949cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab666f42-90da-44cf-b699-6ecbd9ed2cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab666f42-90da-44cf-b699-6ecbd9ed2cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-318759589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557def8e-b16a-4e0d-8cba-f988c7a0dac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d56e37fad324e4cb9dc672709cefc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:21Z,use_quota=True,user_id='ba2b1bb6bd794b879dfbccfd76f8279d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd2c707-1d31-4cce-91e8-366667666eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd2c707-1d31-4cce-91e8-366667666eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d7c180-d326-48a3-915a-0ec38a6b3182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d7c180-d326-48a3-915a-0ec38a6b3182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557def8e-b16a-4e0d-8cba-f988c7a0dac3', 'volume_name': 'volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8c238b-6723-4bb3-ac71-dbd802587569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8c238b-6723-4bb3-ac71-dbd802587569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b297ee2-9c8b-4ba6-bd23-969177bdc5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:21 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Volume 557def8e-b16a-4e0d-8cba-f988c7a0dac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3', 'volume_size': 1} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-318759589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557def8e-b16a-4e0d-8cba-f988c7a0dac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d56e37fad324e4cb9dc672709cefc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:21Z,use_quota=True,user_id='ba2b1bb6bd794b879dfbccfd76f8279d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Creating volume 557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:21 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-4d6c052a-28f8-4981-9426-3e1fa1d75d0a tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Terminate volume connection completed successfully. Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-4d6c052a-28f8-4981-9426-3e1fa1d75d0a tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Deleting attachment fa759f79-0cec-46f1-9635-68ae7db7f5ef. {{(pid=81927) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 25 02:10:21 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 1073741824 Apr 25 02:10:21 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:21 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.619s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Deleted volume successfully. Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-886bfe7d-4dab-4088-9192-88b44c9a843b tempest-VolumeTypesAccessTest-677569260 None] Lock "cinder-20649a0c-66fd-4315-adf5-6c7c2af1ee2d-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:21 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938" returned: 0 in 0.651s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:21 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 Apr 25 02:10:21 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "cinder-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "cinder-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "cinder-quobyte-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "cinder-quobyte-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2761e8bd-038b-4cd3-aea5-12785604f0e6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:22 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 1073741824" returned: 0 in 0.792s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:22 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 Apr 25 02:10:22 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:22 devstack sudo[86825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c Apr 25 02:10:22 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:22 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938" returned: 1 in 0.882s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Downloaded image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}])) to volume eb4193fe-0295-4dc2-b80a-aa671b36c938 successfully. {{(pid=81927) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Temporary image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 for user cc2a4f98eaff4ef1b45c185c96092d57 is deleted. {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Marking volume eb4193fe-0295-4dc2-b80a-aa671b36c938 as bootable. {{(pid=81927) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Copying metadata from image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 to eb4193fe-0295-4dc2-b80a-aa671b36c938. {{(pid=81927) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Creating volume glance metadata for volume eb4193fe-0295-4dc2-b80a-aa671b36c938 backed by image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81927) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c041896-4374-4800-902a-6befa779c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4193fe-0295-4dc2-b80a-aa671b36c938', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61fa45f-804d-4ead-aec8-1a62aab79b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:22 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Volume volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 (eb4193fe-0295-4dc2-b80a-aa671b36c938): created successfully Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61fa45f-804d-4ead-aec8-1a62aab79b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Flow 'volume_create_manager' (7706f5d0-4ce4-40dd-8113-b6a88b6d519e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:22 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dd49699c-b112-4fdc-bb1d-9fa5e0dfb394 tempest-VolumesExtendTest-26082683 None] Created volume successfully. Apr 25 02:10:22 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3" returned: 0 in 0.635s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:22 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b297ee2-9c8b-4ba6-bd23-969177bdc5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3418094d-6be3-4fc1-9a7c-71378504877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c" returned: 0 in 0.757s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:22 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Volume volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 (557def8e-b16a-4e0d-8cba-f988c7a0dac3): created successfully Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3418094d-6be3-4fc1-9a7c-71378504877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:22 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c Apr 25 02:10:22 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Flow 'volume_create_manager' (d8061466-fde8-4685-aace-9752e98949cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:22 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-68fcf265-b4ea-4c86-9959-7b1029baaae2 tempest-VolumesDeleteCascade-1400265833 None] Created volume successfully. Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88f72c0-4df3-4723-8a25-7b71d45ded7e]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:23 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 Apr 25 02:10:23 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:23 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c" returned: 0 in 0.562s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "cinder-quobyte-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c" released by "delete_volume" :: held 1.367s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG cinder.quota [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Created reservations ['9539e86e-0fb6-4e05-a226-acd9523901dd', '3395542b-a8f8-4364-9e21-7f28d43f42fb', 'b024bfe3-faef-4bf3-974a-40ac87166170', '34ec8cd5-47dc-4574-9a52-8089cc116137'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:23 devstack sudo[86841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:23 devstack sudo[86841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:23 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938" returned: 0 in 0.708s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:24 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 Apr 25 02:10:24 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:24 devstack sudo[86841]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.599s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG cinder.manager [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:24 devstack cinder-volume[81927]: INFO cinder.volume.manager [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Deleted volume successfully. Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [req-b4928be7-bdd0-4fdb-89e6-1cbc3d0cc5f3 req-2e75d49b-d186-4541-bdee-573f2d6a75d6 tempest-ServerBootFromVolumeStableRescueTest-941098874 None] Lock "cinder-ecbd4863-fcf1-45ba-a476-e3a7cba37a1c-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:24 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938" returned: 1 in 0.691s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 2G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 2G" returned: 0 in 0.103s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.553s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Creating offline snapshot ff2c30c6-b83f-4289-ac1a-12a8fd46f410 of volume 557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:10:24 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ea4e1a66-e91d-4e73-9ff4-4c68af46156d tempest-VolumesExtendTest-26082683 None] Extend volume completed successfully. Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e99b07-fa08-4248-b3c9-c68614824880]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:24 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 Apr 25 02:10:24 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:25 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3" returned: 0 in 0.718s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:25 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 1G Apr 25 02:10:25 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Acquiring lock "cinder-eb4193fe-0295-4dc2-b80a-aa671b36c938-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Lock "cinder-eb4193fe-0295-4dc2-b80a-aa671b36c938-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Acquiring lock "cinder-quobyte-eb4193fe-0295-4dc2-b80a-aa671b36c938" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Lock "cinder-quobyte-eb4193fe-0295-4dc2-b80a-aa671b36c938" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:25 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeb73d9-ca5d-4255-b4a9-3f26772b4de1]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:25 devstack sudo[86862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 Apr 25 02:10:25 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:26 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 1G" returned: 0 in 0.980s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:26 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 Apr 25 02:10:26 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:26 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938" returned: 0 in 1.055s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:27 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 Apr 25 02:10:27 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:27 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410" returned: 0 in 0.776s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:27 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 is being set with open permissions: ugo+rw Apr 25 02:10:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:27 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 Apr 25 02:10:27 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:27 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938" returned: 1 in 0.706s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:10:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:27 devstack sudo[86946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938 Apr 25 02:10:27 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:27 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410" returned: 0 in 0.507s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:27 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.info Apr 25 02:10:27 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:28 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-eb4193fe-0295-4dc2-b80a-aa671b36c938" returned: 0 in 0.600s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Lock "cinder-quobyte-eb4193fe-0295-4dc2-b80a-aa671b36c938" released by "delete_volume" :: held 2.440s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Created reservations ['470d5a1e-4f8e-4a0c-a92e-4102d4008ad1', '3aea0eea-546d-4bdd-b202-ac014974f710', '7eaa699f-1a26-4d82-b746-6923d85a3bba', '9f62abf0-4afa-49a0-9b94-9543326ee130'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:28 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:28 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Flow 'volume_create_manager' (e89b192d-ef10-4501-95ca-0569dc258205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5328553f-c1a0-4fb5-b4e9-6b5fc3826d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5328553f-c1a0-4fb5-b4e9-6b5fc3826d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-103161249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f35860-b48e-4a87-b346-459e7546ffdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca39639769c476a8cbd8be1cffb4c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:28Z,use_quota=True,user_id='f58f7c9ed8ac4ebbbb0c8cae46b02fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436ea388-513e-4ccc-9c59-5a48a400e709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436ea388-513e-4ccc-9c59-5a48a400e709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62272e0-8390-462a-9557-ebda03b1dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.image.glance [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Creating Keystone auth plugin from conf {{(pid=81927) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 25 02:10:28 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.info" returned: 0 in 0.848s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:28 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.info is being set with open permissions: ugo+rw Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:28 devstack sudo[86957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.info Apr 25 02:10:28 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62272e0-8390-462a-9557-ebda03b1dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13f35860-b48e-4a87-b346-459e7546ffdc', 'volume_name': 'volume-13f35860-b48e-4a87-b346-459e7546ffdc', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261d87e5-179d-4143-9b4a-b77755448cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261d87e5-179d-4143-9b4a-b77755448cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca41c96-e068-4987-9cdd-1fd76a0a4143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:28 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Volume 13f35860-b48e-4a87-b346-459e7546ffdc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13f35860-b48e-4a87-b346-459e7546ffdc', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 25 02:10:28 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Trying to clone 13f35860-b48e-4a87-b346-459e7546ffdc from image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]). {{(pid=81927) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 25 02:10:29 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.736s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:29 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Deleted volume successfully. Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 25 02:10:29 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Image download 20.69 MB at 20.69 MB/s Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-69cac3e3-0a12-4913-8fa4-aa9b3d6986d1 tempest-VolumesExtendTest-26082683 None] Lock "cinder-eb4193fe-0295-4dc2-b80a-aa671b36c938-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:29 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.info" returned: 0 in 0.515s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.502s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[96690048-edba-46a4-b2a5-7f26fc97fb12]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:29 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d5f6431e-facd-4429-82ee-fc96601fcbcc tempest-VolumesDeleteCascade-1400265833 None] Create snapshot completed successfully Apr 25 02:10:29 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD Apr 25 02:10:29 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Flow 'volume_create_manager' (736994f8-21e1-4bb5-b03e-45c326058629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6ae7a3-9c5f-49ac-8a9e-ac6ca1f904e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6ae7a3-9c5f-49ac-8a9e-ac6ca1f904e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1068310573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d5146e-f853-46a0-a169-b1b01dedd3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a8f60584746c48d347a3bdfe6a03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:29Z,use_quota=True,user_id='cc2a4f98eaff4ef1b45c185c96092d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961609e2-48db-44c2-a707-847c54bef477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961609e2-48db-44c2-a707-847c54bef477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4495c9c2-1c3b-4551-9294-5023dd0419d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4495c9c2-1c3b-4551-9294-5023dd0419d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d5146e-f853-46a0-a169-b1b01dedd3e2', 'volume_name': 'volume-70d5146e-f853-46a0-a169-b1b01dedd3e2', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2bd595-e40c-4231-9fdf-f0cb3dbf4130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2bd595-e40c-4231-9fdf-f0cb3dbf4130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ebea0b-ee48-4407-9aaf-66066f0078da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Volume 70d5146e-f853-46a0-a169-b1b01dedd3e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d5146e-f853-46a0-a169-b1b01dedd3e2', 'volume_size': 1} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1068310573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d5146e-f853-46a0-a169-b1b01dedd3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627a8f60584746c48d347a3bdfe6a03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:29Z,use_quota=True,user_id='cc2a4f98eaff4ef1b45c185c96092d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Creating volume 70d5146e-f853-46a0-a169-b1b01dedd3e2 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:29 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:29 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 1073741824 Apr 25 02:10:29 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:29 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD" returned: 0 in 0.612s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Temporary image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 is fetched for user f58f7c9ed8ac4ebbbb0c8cae46b02fb9. {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f013aff-51df-4c1c-afe3-131b1e77cbc4]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:30 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD Apr 25 02:10:30 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:30 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 1073741824" returned: 0 in 0.762s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:30 devstack sudo[86974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 Apr 25 02:10:30 devstack sudo[86974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:30 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD" returned: 0 in 0.609s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:30 devstack sudo[86974]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2" returned: 0 in 0.479s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.579s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ebea0b-ee48-4407-9aaf-66066f0078da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d5146e-f853-46a0-a169-b1b01dedd3e2', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953d5f3c-0452-4262-86a5-4fb4bd1bfac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Creating offline snapshot dec6fa1a-19d0-47fd-b107-615f502eda34 of volume 557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:10:30 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Volume volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 (70d5146e-f853-46a0-a169-b1b01dedd3e2): created successfully Apr 25 02:10:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953d5f3c-0452-4262-86a5-4fb4bd1bfac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Flow 'volume_create_manager' (736994f8-21e1-4bb5-b03e-45c326058629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:31 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6fad1f-0b0b-44b8-a0cc-ad46a801eaa8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f3d96b4f-9b71-4555-9ba3-ee15b75a47a4 tempest-VolumesExtendTest-26082683 None] Created volume successfully. Apr 25 02:10:31 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 Apr 25 02:10:31 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:31 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410" returned: 0 in 0.574s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:10:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:31 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 1G Apr 25 02:10:31 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:32 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 1G" returned: 0 in 0.660s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:32 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 Apr 25 02:10:32 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:32 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34" returned: 0 in 0.539s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:32 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 is being set with open permissions: ugo+rw Apr 25 02:10:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:32 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 Apr 25 02:10:32 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:33 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34" returned: 0 in 0.459s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.679s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-103161249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f35860-b48e-4a87-b346-459e7546ffdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca39639769c476a8cbd8be1cffb4c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:28Z,use_quota=True,user_id='f58f7c9ed8ac4ebbbb0c8cae46b02fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Creating volume 13f35860-b48e-4a87-b346-459e7546ffdc {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:33 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:33 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc 1073741824 Apr 25 02:10:33 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:33 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e0edb484-2a0d-41dc-a3dd-bcff00aa6821 tempest-VolumesDeleteCascade-1400265833 None] Create snapshot completed successfully Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-557def8e-b16a-4e0d-8cba-f988c7a0dac3-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-557def8e-b16a-4e0d-8cba-f988c7a0dac3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Performing cascade delete. {{(pid=81927) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-dec6fa1a-19d0-47fd-b107-615f502eda34-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-dec6fa1a-19d0-47fd-b107-615f502eda34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-557def8e-b16a-4e0d-8cba-f988c7a0dac3" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-557def8e-b16a-4e0d-8cba-f988c7a0dac3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-dec6fa1a-19d0-47fd-b107-615f502eda34" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-dec6fa1a-19d0-47fd-b107-615f502eda34" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Deleting offline snapshot dec6fa1a-19d0-47fd-b107-615f502eda34 of volume 557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] snapshot_file for this snap is: volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6964d66f-935a-4756-9a9f-92b156afa8b3]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:33 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 Apr 25 02:10:33 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:34 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc 1073741824" returned: 0 in 0.730s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:34 devstack sudo[87007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc Apr 25 02:10:34 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:34 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34" returned: 0 in 0.617s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb981e1-d3fb-4f5f-88de-19cca5581045]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:34 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 Apr 25 02:10:34 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:34 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc" returned: 0 in 0.489s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.706s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Creating offline snapshot 02c95393-ae21-42aa-8e6d-c0038b1981b7 of volume 70d5146e-f853-46a0-a169-b1b01dedd3e2 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f80958f-1d37-4a1b-ac3e-1e8bd3355c3e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Attempting download of ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}])) to volume 13f35860-b48e-4a87-b346-459e7546ffdc. {{(pid=81927) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a97806-2dfd-47ad-a248-c7075a63af7d]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_oi_h27j4 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:34 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 Apr 25 02:10:34 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:34 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_oi_h27j4 Apr 25 02:10:34 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:35 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410" returned: 0 in 0.646s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:35 devstack sudo[87022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 Apr 25 02:10:35 devstack sudo[87022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:35 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2" returned: 0 in 0.627s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:35 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 1G Apr 25 02:10:35 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:35 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_oi_h27j4" returned: 0 in 0.627s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_oi_h27j4 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:35 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_oi_h27j4 Apr 25 02:10:35 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:35 devstack sudo[87022]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34" returned: 0 in 0.801s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:35 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34 Apr 25 02:10:35 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:35 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_oi_h27j4" returned: 1 in 0.564s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_oi_h27j4' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2417a3d-2b7f-46dc-9b7b-745dbdd2514a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:36 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD Apr 25 02:10:36 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:36 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 1G" returned: 0 in 0.861s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:36 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 Apr 25 02:10:36 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:36 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.dec6fa1a-19d0-47fd-b107-615f502eda34" returned: 0 in 0.568s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-dec6fa1a-19d0-47fd-b107-615f502eda34" released by "_delete_snapshot" :: held 2.762s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-557def8e-b16a-4e0d-8cba-f988c7a0dac3" released by "delete_snapshot" :: held 2.782s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Created reservations ['6b44956e-88b3-430a-8ff5-56ad8cd8d672', '26da3886-4989-4fc1-a8b5-1d75d2d6b638', 'd02f89fd-c8b5-43ed-9879-ef8aa571f8e1', '8baaceb4-a875-466d-a5bc-8655460df6b9'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:36 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD" returned: 0 in 0.674s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 was qcow2, converting to raw {{(pid=81927) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:36 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc Apr 25 02:10:36 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:36 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Delete snapshot completed successfully. Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-dec6fa1a-19d0-47fd-b107-615f502eda34-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-ff2c30c6-b83f-4289-ac1a-12a8fd46f410-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-ff2c30c6-b83f-4289-ac1a-12a8fd46f410-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-557def8e-b16a-4e0d-8cba-f988c7a0dac3" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-557def8e-b16a-4e0d-8cba-f988c7a0dac3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-ff2c30c6-b83f-4289-ac1a-12a8fd46f410" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-ff2c30c6-b83f-4289-ac1a-12a8fd46f410" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Deleting offline snapshot ff2c30c6-b83f-4289-ac1a-12a8fd46f410 of volume 557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] snapshot_file for this snap is: volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dcda54-baf0-4ba4-aac6-41a5b3eb756e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:36 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7" returned: 0 in 0.725s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:36 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 is being set with open permissions: ugo+rw Apr 25 02:10:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:36 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 Apr 25 02:10:36 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:36 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 Apr 25 02:10:36 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:37 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7" returned: 0 in 0.599s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:37 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.info Apr 25 02:10:37 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:37 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410" returned: 0 in 0.762s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:37 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:10:37 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf39d32f-bf51-419a-bf18-681e92f5b774]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:37 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 Apr 25 02:10:37 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:38 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.info" returned: 0 in 0.658s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:38 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.info is being set with open permissions: ugo+rw Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:38 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc" returned: 0 in 1.568s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_ylzcp_4udevstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:10:38 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Converted 112.00 MB image at 71.32 MB/s Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:38 devstack sudo[87076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.info Apr 25 02:10:38 devstack sudo[87076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:38 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc 1G Apr 25 02:10:38 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:38 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3" returned: 0 in 0.710s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:38 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 Apr 25 02:10:38 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:38 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc 1G" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:38 devstack sudo[87076]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.info" returned: 0 in 0.623s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.196s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce7656-ca8f-425f-820a-345a418e4bdf]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:38 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9f178c3e-afc9-4c1c-bbf6-c7faca66bea4 tempest-VolumesExtendTest-26082683 None] Create snapshot completed successfully Apr 25 02:10:38 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc Apr 25 02:10:38 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:38 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410" returned: 0 in 0.633s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:38 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410 Apr 25 02:10:38 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Flow 'volume_create_manager' (6878c285-4447-4288-a251-3f03b50a33ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f777ac6e-2df7-46cb-869b-1c992dbbb17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf6dc232-57d9-442d-a542-f9fcbb0e8a08 tempest-VolumesExtendTest-26082683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf6dc232-57d9-442d-a542-f9fcbb0e8a08 tempest-VolumesExtendTest-26082683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f777ac6e-2df7-46cb-869b-1c992dbbb17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-222627422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d9c13e-26e2-410f-8b63-6cea88ea75b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0d3b09b8d344d528dd08666290d0f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:39Z,use_quota=True,user_id='3a854fded09b498c89dfa8af8047fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05bb248f-b0de-44f0-b324-ffae4c7a97ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05bb248f-b0de-44f0-b324-ffae4c7a97ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ea3e1b-2e45-4e9a-ac1e-1e1665296ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ea3e1b-2e45-4e9a-ac1e-1e1665296ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d9c13e-26e2-410f-8b63-6cea88ea75b7', 'volume_name': 'volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8daafa-7c34-44ae-9082-bd4b4cc324c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8daafa-7c34-44ae-9082-bd4b4cc324c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:39 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f71d05-8bda-44f8-9541-1d7f1c8b0d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:39 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Volume b2d9c13e-26e2-410f-8b63-6cea88ea75b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7', 'volume_size': 1} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fefb168-3a5a-4afe-ab89-83b9533e578e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf6dc232-57d9-442d-a542-f9fcbb0e8a08 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc" returned: 0 in 0.676s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:39 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3.ff2c30c6-b83f-4289-ac1a-12a8fd46f410" returned: 0 in 0.582s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-ff2c30c6-b83f-4289-ac1a-12a8fd46f410" released by "_delete_snapshot" :: held 2.801s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-557def8e-b16a-4e0d-8cba-f988c7a0dac3" released by "delete_snapshot" :: held 2.829s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:39 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc Apr 25 02:10:39 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:39 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 Apr 25 02:10:39 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Created reservations ['ab017743-8a48-4f21-8c06-4c5f2ffdd6a0', 'dd5ae65b-8575-4061-b637-6135b8d744fa', '1652ea59-9db3-4dad-b0ed-9c609fa4fc95', '015fbcc3-0031-45e6-bf57-10f35399ed15'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:39 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Delete snapshot completed successfully. Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-ff2c30c6-b83f-4289-ac1a-12a8fd46f410-delete_snapshot" released by "delete_snapshot" :: held 2.994s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Snapshots deleted, issuing volume delete {{(pid=81927) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-557def8e-b16a-4e0d-8cba-f988c7a0dac3" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-557def8e-b16a-4e0d-8cba-f988c7a0dac3" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f753d8-0464-4997-88c1-736110be2923]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:39 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 Apr 25 02:10:39 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:39 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf6dc232-57d9-442d-a542-f9fcbb0e8a08 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2" returned: 0 in 0.561s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf6dc232-57d9-442d-a542-f9fcbb0e8a08 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 2G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:40 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc" returned: 1 in 0.587s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Downloaded image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}])) to volume 13f35860-b48e-4a87-b346-459e7546ffdc successfully. {{(pid=81927) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Temporary image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 for user f58f7c9ed8ac4ebbbb0c8cae46b02fb9 is deleted. {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Marking volume 13f35860-b48e-4a87-b346-459e7546ffdc as bootable. {{(pid=81927) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Copying metadata from image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 to 13f35860-b48e-4a87-b346-459e7546ffdc. {{(pid=81927) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Creating volume glance metadata for volume 13f35860-b48e-4a87-b346-459e7546ffdc backed by image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81927) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=134,cinder:SELECT=114,cinder:INSERT=35,cinder:DELETE=10 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf6dc232-57d9-442d-a542-f9fcbb0e8a08 tempest-VolumesExtendTest-26082683 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 2G" returned: 0 in 0.136s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf6dc232-57d9-442d-a542-f9fcbb0e8a08 tempest-VolumesExtendTest-26082683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.773s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.726s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-222627422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d9c13e-26e2-410f-8b63-6cea88ea75b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0d3b09b8d344d528dd08666290d0f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:39Z,use_quota=True,user_id='3a854fded09b498c89dfa8af8047fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Creating volume b2d9c13e-26e2-410f-8b63-6cea88ea75b7 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:40 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:40 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 1073741824 Apr 25 02:10:40 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca41c96-e068-4987-9cdd-1fd76a0a4143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f35860-b48e-4a87-b346-459e7546ffdc', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae0269b-2dd1-43c7-b4ad-3575b5b66fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:40 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Volume volume-13f35860-b48e-4a87-b346-459e7546ffdc (13f35860-b48e-4a87-b346-459e7546ffdc): created successfully Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae0269b-2dd1-43c7-b4ad-3575b5b66fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Flow 'volume_create_manager' (e89b192d-ef10-4501-95ca-0569dc258205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:40 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bce52c60-2389-40b5-9122-9099ef149832 tempest-VolumesImageMetadata-1258297715 None] Created volume successfully. Apr 25 02:10:40 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bf6dc232-57d9-442d-a542-f9fcbb0e8a08 tempest-VolumesExtendTest-26082683 None] Extend volume completed successfully. Apr 25 02:10:40 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3" returned: 0 in 0.606s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:40 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3 Apr 25 02:10:40 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Acquiring lock "cinder-02c95393-ae21-42aa-8e6d-c0038b1981b7-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Lock "cinder-02c95393-ae21-42aa-8e6d-c0038b1981b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Acquiring lock "cinder-quobyte-70d5146e-f853-46a0-a169-b1b01dedd3e2" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Lock "cinder-quobyte-70d5146e-f853-46a0-a169-b1b01dedd3e2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Acquiring lock "cinder-quobyte-02c95393-ae21-42aa-8e6d-c0038b1981b7" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Lock "cinder-quobyte-02c95393-ae21-42aa-8e6d-c0038b1981b7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Deleting offline snapshot 02c95393-ae21-42aa-8e6d-c0038b1981b7 of volume 70d5146e-f853-46a0-a169-b1b01dedd3e2 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] snapshot_file for this snap is: volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba6f5ef-9008-46d2-9612-d1d5055b305e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Acquiring lock "cinder-13f35860-b48e-4a87-b346-459e7546ffdc-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:40 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 Apr 25 02:10:40 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Lock "cinder-13f35860-b48e-4a87-b346-459e7546ffdc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Acquiring lock "cinder-quobyte-13f35860-b48e-4a87-b346-459e7546ffdc" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Lock "cinder-quobyte-13f35860-b48e-4a87-b346-459e7546ffdc" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:40 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:40 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-557def8e-b16a-4e0d-8cba-f988c7a0dac3" returned: 0 in 0.612s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 1073741824" returned: 0 in 0.748s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-557def8e-b16a-4e0d-8cba-f988c7a0dac3" released by "delete_volume" :: held 1.279s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88b98bd-ce1c-4420-bc6b-df341d069d8b]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:41 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 Apr 25 02:10:41 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Created reservations ['947b52c5-15c2-4b01-bcdf-706c16d5793d', '6cbe6f09-d12f-447b-a768-d54e09a9728c', '573eb0c9-f462-4e1c-bd44-18d25515cb43', '1983ac35-461d-4dce-8ad9-59ec67368817'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:41 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc Apr 25 02:10:41 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:41 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:41 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:41 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7" returned: 0 in 0.660s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70d5146e-f853-46a0-a169-b1b01dedd3e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[67efc2d8-391b-4fef-9c6a-8d4480cc275f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:41 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 Apr 25 02:10:41 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:41 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7" returned: 0 in 0.521s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f71d05-8bda-44f8-9541-1d7f1c8b0d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d388eb4c-6c8f-4a72-bc99-309dc364a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:41 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Volume volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 (b2d9c13e-26e2-410f-8b63-6cea88ea75b7): created successfully Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d388eb4c-6c8f-4a72-bc99-309dc364a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:41 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Flow 'volume_create_manager' (6878c285-4447-4288-a251-3f03b50a33ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc" returned: 0 in 0.613s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:41 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:41 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-2e1faef3-5ce9-425b-8798-05fabe1fc71e tempest-VolumesTestJSON-695084505 None] Created volume successfully. Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.485s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:41 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Deleted volume successfully. Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77c5eff8-97a7-4978-8094-289b33f85fc4 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-557def8e-b16a-4e0d-8cba-f988c7a0dac3-delete_volume" released by "delete_volume" :: held 8.084s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:41 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc Apr 25 02:10:41 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:41 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2" returned: 0 in 0.597s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:41 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 Apr 25 02:10:41 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:42 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc" returned: 1 in 0.554s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:42 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc Apr 25 02:10:42 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:42 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7" returned: 0 in 0.617s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:42 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7 Apr 25 02:10:42 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:42 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Flow 'volume_create_manager' (5125b1b1-d38d-4568-b2ab-177b96cbd6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16e8ad9-4faf-4571-ab81-eb1cd0c62fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-13f35860-b48e-4a87-b346-459e7546ffdc" returned: 0 in 0.613s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16e8ad9-4faf-4571-ab81-eb1cd0c62fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1726035350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded8293c-7d95-461f-9a86-e5536d55e3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d56e37fad324e4cb9dc672709cefc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:43Z,use_quota=True,user_id='ba2b1bb6bd794b879dfbccfd76f8279d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ae62d7-acf8-4f82-828d-b4c283ebfd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ae62d7-acf8-4f82-828d-b4c283ebfd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237e2cc3-53f1-4cd5-80a7-84e475134cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237e2cc3-53f1-4cd5-80a7-84e475134cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded8293c-7d95-461f-9a86-e5536d55e3e5', 'volume_name': 'volume-ded8293c-7d95-461f-9a86-e5536d55e3e5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc65c733-ad4e-4096-aa98-7a52e6dc7ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc65c733-ad4e-4096-aa98-7a52e6dc7ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b5befc-f650-4d6f-a150-b22c41c628fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:42 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Volume ded8293c-7d95-461f-9a86-e5536d55e3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded8293c-7d95-461f-9a86-e5536d55e3e5', 'volume_size': 1} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1726035350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded8293c-7d95-461f-9a86-e5536d55e3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d56e37fad324e4cb9dc672709cefc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:43Z,use_quota=True,user_id='ba2b1bb6bd794b879dfbccfd76f8279d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Creating volume ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:42 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Lock "cinder-quobyte-13f35860-b48e-4a87-b346-459e7546ffdc" released by "delete_volume" :: held 1.918s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:42 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 1073741824 Apr 25 02:10:42 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Created reservations ['6e99c971-69f7-47ba-871e-8a450877fa9d', '322fcbf9-97f8-4d84-adc5-6dbd23961c0e', '78db0e2f-5e1a-4376-9099-8f3304ee00fe', '2b1a0be4-f106-4387-8a66-8f22e665fb15'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:42 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:42 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Flow 'volume_create_manager' (053cd367-e36d-4841-b337-35c3e19a1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca20218-b015-41e9-8a9e-08ce93ef1fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:43 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca20218-b015-41e9-8a9e-08ce93ef1fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-678346596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3609e75-e862-44db-98d1-43ffb3311b7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0d3b09b8d344d528dd08666290d0f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:43Z,use_quota=True,user_id='3a854fded09b498c89dfa8af8047fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfee65c-4881-4b52-bc58-1b9e4c353126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfee65c-4881-4b52-bc58-1b9e4c353126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6981982-ca96-48ee-80b1-b9eb7277bdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6981982-ca96-48ee-80b1-b9eb7277bdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3609e75-e862-44db-98d1-43ffb3311b7e', 'volume_name': 'volume-a3609e75-e862-44db-98d1-43ffb3311b7e', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a0bcc9-c5f3-45d9-8381-ff51b8a1a5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1a0bcc9-c5f3-45d9-8381-ff51b8a1a5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fc11c5-e59b-414e-8163-c4bb1b3a2b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:43 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Volume a3609e75-e862-44db-98d1-43ffb3311b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3609e75-e862-44db-98d1-43ffb3311b7e', 'volume_size': 1} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2.02c95393-ae21-42aa-8e6d-c0038b1981b7" returned: 0 in 0.699s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Lock "cinder-quobyte-02c95393-ae21-42aa-8e6d-c0038b1981b7" released by "_delete_snapshot" :: held 2.686s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Lock "cinder-quobyte-70d5146e-f853-46a0-a169-b1b01dedd3e2" released by "delete_snapshot" :: held 2.716s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Created reservations ['64b68ec9-877d-4951-b7a5-3c8d0b786f5e', '23de63f0-2c30-4dab-aa79-53758c10959b', '7902efb3-63ef-4529-9440-dbbbcac37432', '3fcf616f-7f69-42c9-86f4-30494c317711'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:43 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Delete snapshot completed successfully. Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-466c4d9f-2979-493d-bbe3-c48b941df97c tempest-VolumesExtendTest-26082683 None] Lock "cinder-02c95393-ae21-42aa-8e6d-c0038b1981b7-delete_snapshot" released by "delete_snapshot" :: held 2.894s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:43 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.685s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:43 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Deleted volume successfully. Apr 25 02:10:43 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 1073741824" returned: 0 in 0.824s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9e998f40-9408-4eba-b35d-b086d03e458a tempest-VolumesImageMetadata-1258297715 None] Lock "cinder-13f35860-b48e-4a87-b346-459e7546ffdc-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:43 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 Apr 25 02:10:43 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Acquiring lock "cinder-70d5146e-f853-46a0-a169-b1b01dedd3e2-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Lock "cinder-70d5146e-f853-46a0-a169-b1b01dedd3e2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Acquiring lock "cinder-quobyte-70d5146e-f853-46a0-a169-b1b01dedd3e2" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Lock "cinder-quobyte-70d5146e-f853-46a0-a169-b1b01dedd3e2" acquired by "delete_volume" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe41cb02-ee1f-484f-b2ff-d13b4ccb0b66]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:44 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 Apr 25 02:10:44 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:44 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5" returned: 0 in 0.579s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.977s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-678346596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3609e75-e862-44db-98d1-43ffb3311b7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0d3b09b8d344d528dd08666290d0f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:43Z,use_quota=True,user_id='3a854fded09b498c89dfa8af8047fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Creating volume a3609e75-e862-44db-98d1-43ffb3311b7e {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:44 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b5befc-f650-4d6f-a150-b22c41c628fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded8293c-7d95-461f-9a86-e5536d55e3e5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2bfb4e-3e76-4d54-82f5-596d3708342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:44 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e 1073741824 Apr 25 02:10:44 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:44 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Volume volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 (ded8293c-7d95-461f-9a86-e5536d55e3e5): created successfully Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f2bfb4e-3e76-4d54-82f5-596d3708342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Flow 'volume_create_manager' (5125b1b1-d38d-4568-b2ab-177b96cbd6c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:44 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-10d87b1a-60ad-4764-9de4-b1331295a6e1 tempest-VolumesDeleteCascade-1400265833 None] Created volume successfully. Apr 25 02:10:44 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2" returned: 0 in 0.675s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:44 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2 Apr 25 02:10:44 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:45 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e 1073741824" returned: 0 in 0.850s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:45 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e Apr 25 02:10:45 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:45 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-70d5146e-f853-46a0-a169-b1b01dedd3e2" returned: 0 in 0.590s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Lock "cinder-quobyte-70d5146e-f853-46a0-a169-b1b01dedd3e2" released by "delete_volume" :: held 1.323s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Created reservations ['dd233b1b-3d1d-49e5-b757-4b46b02e13fc', 'ee885985-f631-4aca-add0-21f0aa6de407', 'afe36a25-063f-4cd4-a223-047ff73c5ae9', 'c7989be6-ca04-4786-aea6-ede4a9c5db25'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:45 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:45 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:45 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e" returned: 0 in 0.504s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.614s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fc11c5-e59b-414e-8163-c4bb1b3a2b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3609e75-e862-44db-98d1-43ffb3311b7e', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8435bf4a-8242-4c1a-ba88-f3e05650e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Creating offline snapshot a49f2dbe-05b7-466d-8eae-e60235c7616a of volume ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:10:45 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Volume volume-a3609e75-e862-44db-98d1-43ffb3311b7e (a3609e75-e862-44db-98d1-43ffb3311b7e): created successfully Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8435bf4a-8242-4c1a-ba88-f3e05650e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Flow 'volume_create_manager' (053cd367-e36d-4841-b337-35c3e19a1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[de90784a-220b-44d7-9762-b4758a02abdc]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:45 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-10888a68-5317-4508-b399-1628ebf1ba9f tempest-VolumesTestJSON-695084505 None] Created volume successfully. Apr 25 02:10:45 devstack sudo[87190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 Apr 25 02:10:45 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:45 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.509s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:45 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Deleted volume successfully. Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6f20ae29-4d98-4032-98f8-b14dd7b57025 tempest-VolumesExtendTest-26082683 None] Lock "cinder-70d5146e-f853-46a0-a169-b1b01dedd3e2-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (aefa9ce4-b9a8-4c5f-b34a-a5ca6e5ae338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99676a60-7691-48ef-ac6f-0eb2be275b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99676a60-7691-48ef-ac6f-0eb2be275b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1624848400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd572509-48ee-4916-a6de-7f9a7a3a70bc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:46Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d206a09f-8592-4e5a-9ed3-44f3c02eb114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d206a09f-8592-4e5a-9ed3-44f3c02eb114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21dc92d0-9b7d-4484-8d96-2a6672128d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21dc92d0-9b7d-4484-8d96-2a6672128d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd572509-48ee-4916-a6de-7f9a7a3a70bc', 'volume_name': 'volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fa2c45-b3c1-475f-ad30-74e29c8d6ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fa2c45-b3c1-475f-ad30-74e29c8d6ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3da712-ef87-4ea4-bcf2-9fb3a79de3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Volume dd572509-48ee-4916-a6de-7f9a7a3a70bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc', 'volume_size': 1} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:46 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5" returned: 0 in 0.670s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:46 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a 1G Apr 25 02:10:46 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Flow 'volume_create_manager' (efcf964d-dc46-48da-9915-d8011d4885d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8100d2a-6598-4d55-ae1a-2aabd30dedc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8100d2a-6598-4d55-ae1a-2aabd30dedc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-955831086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae67518f-65b9-46d4-aa5b-99c06a0a95fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0d3b09b8d344d528dd08666290d0f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:47Z,use_quota=True,user_id='3a854fded09b498c89dfa8af8047fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a5635c-0b57-46fc-8ee4-b66396ee32b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a5635c-0b57-46fc-8ee4-b66396ee32b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e96dbef-651b-4989-9969-68642c21b8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e96dbef-651b-4989-9969-68642c21b8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae67518f-65b9-46d4-aa5b-99c06a0a95fc', 'volume_name': 'volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c44e886-495c-454b-96c6-56f482ef5057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c44e886-495c-454b-96c6-56f482ef5057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0527dac6-de91-4275-8661-cb2bf8302f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:46 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Volume ae67518f-65b9-46d4-aa5b-99c06a0a95fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc', 'volume_size': 1} Apr 25 02:10:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:47 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a 1G" returned: 0 in 0.732s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:47 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a Apr 25 02:10:47 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:47 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a" returned: 0 in 0.543s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:47 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a is being set with open permissions: ugo+rw Apr 25 02:10:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:47 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a Apr 25 02:10:47 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:48 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a" returned: 0 in 0.463s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:48 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.info Apr 25 02:10:48 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Flow 'volume_create_manager' (e82ee076-ba33-43bb-a5b3-82079ee9280d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac7a127-b47f-4c65-bf8c-5894616113eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac7a127-b47f-4c65-bf8c-5894616113eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1472931957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf77a74c-449e-4860-b975-da0f6b8d492e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3a1d4bda347cc8d29014dff6d2359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:49Z,use_quota=True,user_id='5bc032551f1e4c96a2f3a359de024870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ba0465-e1ad-4c1e-8f95-d7141c147d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ba0465-e1ad-4c1e-8f95-d7141c147d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9b3173-914d-4e7a-a574-bba405af6f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af9b3173-914d-4e7a-a574-bba405af6f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf77a74c-449e-4860-b975-da0f6b8d492e', 'volume_name': 'volume-bf77a74c-449e-4860-b975-da0f6b8d492e', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485f82e8-353b-411e-8128-e06a5858f047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485f82e8-353b-411e-8128-e06a5858f047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:48 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8539579f-7ad0-4a8f-b4b1-8b5f039e815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:48 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Volume bf77a74c-449e-4860-b975-da0f6b8d492e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf77a74c-449e-4860-b975-da0f6b8d492e', 'volume_size': 1} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.info" returned: 0 in 0.476s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:48 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.info is being set with open permissions: ugo+rw Apr 25 02:10:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:48 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.info Apr 25 02:10:48 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:49 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.info" returned: 0 in 0.459s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.451s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.053s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1624848400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd572509-48ee-4916-a6de-7f9a7a3a70bc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:46Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Creating volume dd572509-48ee-4916-a6de-7f9a7a3a70bc {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:49 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:49 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc 1073741824 Apr 25 02:10:49 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:49 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ab1b9e13-552a-41e8-aff5-f760699a8957 tempest-VolumesDeleteCascade-1400265833 None] Create snapshot completed successfully Apr 25 02:10:49 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc 1073741824" returned: 0 in 0.620s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:49 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc Apr 25 02:10:49 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:50 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc" returned: 0 in 0.455s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.352s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-955831086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae67518f-65b9-46d4-aa5b-99c06a0a95fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0d3b09b8d344d528dd08666290d0f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:47Z,use_quota=True,user_id='3a854fded09b498c89dfa8af8047fd5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Creating volume ae67518f-65b9-46d4-aa5b-99c06a0a95fc {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:50 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3da712-ef87-4ea4-bcf2-9fb3a79de3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348ac4d1-7d2c-4489-8610-3d0d61db9d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:50 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc 1073741824 Apr 25 02:10:50 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:50 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Volume volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc (dd572509-48ee-4916-a6de-7f9a7a3a70bc): created successfully Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348ac4d1-7d2c-4489-8610-3d0d61db9d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (aefa9ce4-b9a8-4c5f-b34a-a5ca6e5ae338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:50 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ef1f1a3b-00f3-4de5-9a29-8fb0491cbfd3 tempest-VolumesGetTest-1060268551 None] Created volume successfully. Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Flow 'volume_create_manager' (00171667-11cc-4a26-806b-1ce2a014b193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfe91dc-443a-48a9-9249-21cc8ea5db7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfe91dc-443a-48a9-9249-21cc8ea5db7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1243997743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a932278-9481-433d-a6bb-b0442543136f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d56e37fad324e4cb9dc672709cefc92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a49f2dbe-05b7-466d-8eae-e60235c7616a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:51Z,use_quota=True,user_id='ba2b1bb6bd794b879dfbccfd76f8279d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b46d62-0af5-4201-bb60-b9348b479697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b46d62-0af5-4201-bb60-b9348b479697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1ed91c-1f5e-412d-b329-c7a6968622d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1ed91c-1f5e-412d-b329-c7a6968622d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a932278-9481-433d-a6bb-b0442543136f', 'volume_name': 'volume-7a932278-9481-433d-a6bb-b0442543136f', 'volume_size': 1, 'snapshot_id': 'a49f2dbe-05b7-466d-8eae-e60235c7616a'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c78563-c4fc-4c02-bf8e-0f429fe51bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c78563-c4fc-4c02-bf8e-0f429fe51bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc5942c-44b3-4d02-9720-8e0fe26b51f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:50 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Volume 7a932278-9481-433d-a6bb-b0442543136f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a932278-9481-433d-a6bb-b0442543136f', 'volume_size': 1, 'snapshot_id': 'a49f2dbe-05b7-466d-8eae-e60235c7616a'} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:50 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc 1073741824" returned: 0 in 0.621s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:50 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc Apr 25 02:10:50 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:51 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc" returned: 0 in 0.478s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.770s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1472931957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf77a74c-449e-4860-b975-da0f6b8d492e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbb3a1d4bda347cc8d29014dff6d2359',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:49Z,use_quota=True,user_id='5bc032551f1e4c96a2f3a359de024870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Creating volume bf77a74c-449e-4860-b975-da0f6b8d492e {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:51 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0527dac6-de91-4275-8661-cb2bf8302f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:51 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e 1073741824 Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde1fb1b-17f4-48da-8aa9-3fdd45521780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:51 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Volume volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc (ae67518f-65b9-46d4-aa5b-99c06a0a95fc): created successfully Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde1fb1b-17f4-48da-8aa9-3fdd45521780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Flow 'volume_create_manager' (efcf964d-dc46-48da-9915-d8011d4885d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:51 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-7b464f4f-3c53-4f18-b2d7-fb248c7963d7 tempest-VolumesTestJSON-695084505 None] Created volume successfully. Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (18187f5b-b39e-4a56-8c10-3ab01fb0e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f8f4be-1484-4505-bde2-0a7b7ad8e608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f8f4be-1484-4505-bde2-0a7b7ad8e608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-738920918',display_name='tempest-VolumesGetTest-Volume-666433471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:52Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31da772-88a4-4ba2-a378-937990d5f7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31da772-88a4-4ba2-a378-937990d5f7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587b35c4-a7b6-496d-ba8d-bac89d92d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587b35c4-a7b6-496d-ba8d-bac89d92d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb', 'volume_name': 'volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2530b459-9da6-4940-8558-ce97beee7b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2530b459-9da6-4940-8558-ce97beee7b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721a0d3f-2aac-470c-8a01-981ff9f7be15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Volume e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb', 'volume_size': 1} Apr 25 02:10:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:52 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e 1073741824" returned: 0 in 0.675s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:52 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e Apr 25 02:10:52 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:52 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e" returned: 0 in 0.481s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.885s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-a49f2dbe-05b7-466d-8eae-e60235c7616a-7a932278-9481-433d-a6bb-b0442543136f" by "_create_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8539579f-7ad0-4a8f-b4b1-8b5f039e815d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf77a74c-449e-4860-b975-da0f6b8d492e', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9236f04b-2cc0-438c-99d6-832ed612bfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-a49f2dbe-05b7-466d-8eae-e60235c7616a-7a932278-9481-433d-a6bb-b0442543136f" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Creating volume 7a932278-9481-433d-a6bb-b0442543136f from snapshot a49f2dbe-05b7-466d-8eae-e60235c7616a {{(pid=81927) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-7a932278-9481-433d-a6bb-b0442543136f" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Volume volume-bf77a74c-449e-4860-b975-da0f6b8d492e (bf77a74c-449e-4860-b975-da0f6b8d492e): created successfully Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9236f04b-2cc0-438c-99d6-832ed612bfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Flow 'volume_create_manager' (e82ee076-ba33-43bb-a5b3-82079ee9280d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-7a932278-9481-433d-a6bb-b0442543136f" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] snapshot: a49f2dbe-05b7-466d-8eae-e60235c7616a, volume: 7a932278-9481-433d-a6bb-b0442543136f, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:52 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dd7e2c61-9830-422b-bc7b-63f95680fb18 tempest-VolumesNegativeTest-217153213 None] Created volume successfully. Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3cc737-8839-4e74-b8e5-3a332b42dedf]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:52 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a Apr 25 02:10:52 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Acquiring lock "cinder-ae67518f-65b9-46d4-aa5b-99c06a0a95fc-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Lock "cinder-ae67518f-65b9-46d4-aa5b-99c06a0a95fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Acquiring lock "cinder-quobyte-ae67518f-65b9-46d4-aa5b-99c06a0a95fc" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Lock "cinder-quobyte-ae67518f-65b9-46d4-aa5b-99c06a0a95fc" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d6ca5f-2858-40e8-a8ea-c7c032e8fa92]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:53 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc Apr 25 02:10:53 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:53 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a" returned: 0 in 0.664s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ded8293c-7d95-461f-9a86-e5536d55e3e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6cac77-73e2-4c57-a3c6-ef10091f83ed]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:53 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 Apr 25 02:10:53 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:53 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc" returned: 0 in 0.635s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:53 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc Apr 25 02:10:53 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:54 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5" returned: 0 in 0.588s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:54 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f Apr 25 02:10:54 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:54 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ae67518f-65b9-46d4-aa5b-99c06a0a95fc" returned: 0 in 0.500s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Lock "cinder-quobyte-ae67518f-65b9-46d4-aa5b-99c06a0a95fc" released by "delete_volume" :: held 1.171s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Created reservations ['2ee592f9-1b04-47a2-9e52-5982c2e74ce7', '77922d51-2bc5-4a10-8df0-e2b1b78211ed', 'a618b46b-9f99-47db-aabe-da413b1292fb', '28840343-5c6c-4482-9aad-efcc44ce400a'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:54 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:54 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:54 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.665s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:55 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:55 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Deleted volume successfully. Apr 25 02:10:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-97e7a5f1-e4f1-43d8-8631-280c4967dd98 tempest-VolumesTestJSON-695084505 None] Lock "cinder-ae67518f-65b9-46d4-aa5b-99c06a0a95fc-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Acquiring lock "cinder-a3609e75-e862-44db-98d1-43ffb3311b7e-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Lock "cinder-a3609e75-e862-44db-98d1-43ffb3311b7e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Acquiring lock "cinder-quobyte-a3609e75-e862-44db-98d1-43ffb3311b7e" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Lock "cinder-quobyte-a3609e75-e862-44db-98d1-43ffb3311b7e" acquired by "delete_volume" :: waited 0.041s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:55 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8776713-6d85-4399-b340-331efc8089e9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:55 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e Apr 25 02:10:55 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:56 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e" returned: 0 in 1.021s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:56 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e Apr 25 02:10:56 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:57 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a3609e75-e862-44db-98d1-43ffb3311b7e" returned: 0 in 1.019s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:57 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Lock "cinder-quobyte-a3609e75-e862-44db-98d1-43ffb3311b7e" released by "delete_volume" :: held 2.124s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:57 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Created reservations ['4dcccb0a-ab3b-4381-8ba4-c9922838c6c5', '46802273-613e-4d94-bcb9-8dfc6328ad19', 'cb537636-844d-4d3b-93ff-3d8ba162c5da', '01d59290-a0b2-492b-bac1-7a68c99e29a2'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:10:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:10:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:10:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:10:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:10:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:10:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:57 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:10:57 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:10:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Acquiring lock "cinder-b2d9c13e-26e2-410f-8b63-6cea88ea75b7-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Lock "cinder-b2d9c13e-26e2-410f-8b63-6cea88ea75b7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Acquiring lock "cinder-quobyte-b2d9c13e-26e2-410f-8b63-6cea88ea75b7" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:10:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Lock "cinder-quobyte-b2d9c13e-26e2-410f-8b63-6cea88ea75b7" acquired by "delete_volume" :: waited 0.068s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:10:59 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 25 02:10:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.301s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:10:59 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:10:59 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Deleted volume successfully. Apr 25 02:10:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6cf00264-aef3-4114-8556-889cc865f8fc tempest-VolumesTestJSON-695084505 None] Lock "cinder-a3609e75-e862-44db-98d1-43ffb3311b7e-delete_volume" released by "delete_volume" :: held 3.850s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:10:59 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfd7e7f-2105-4a64-b6f3-4bef581ded21]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:10:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:10:59 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 Apr 25 02:10:59 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:00 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:00 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f" returned: 0 in 6.088s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7" returned: 0 in 0.969s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce341775-938d-439f-93d1-5fb0020e3d50]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:00 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7 Apr 25 02:11:00 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:00 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 Apr 25 02:11:00 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:00 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b2d9c13e-26e2-410f-8b63-6cea88ea75b7" returned: 0 in 0.495s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Lock "cinder-quobyte-b2d9c13e-26e2-410f-8b63-6cea88ea75b7" released by "delete_volume" :: held 1.562s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Created reservations ['8dfe3345-0ee9-43f3-9d50-e384518c5063', 'd45cff87-062b-4728-a154-0ecb12ce84c3', 'ba64f77f-d3fb-457b-b5c3-cf47d9c64b4a', '37cb57f1-6295-494a-9372-a0e356222cb6'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:00 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:00 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:01 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5" returned: 0 in 0.877s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:11:01 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Converted 1024.00 MB image at 168.16 MB/s Apr 25 02:11:01 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f is being set with open permissions: ugo+rw Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:01 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f Apr 25 02:11:01 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:01 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.571s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Deleted volume successfully. Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f95370ec-1056-4d82-96ad-ccada1669fd0 tempest-VolumesTestJSON-695084505 None] Lock "cinder-b2d9c13e-26e2-410f-8b63-6cea88ea75b7-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:01 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f" returned: 0 in 0.578s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-7a932278-9481-433d-a6bb-b0442543136f" released by "_copy_volume_from_snapshot" :: held 8.925s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-a49f2dbe-05b7-466d-8eae-e60235c7616a-7a932278-9481-433d-a6bb-b0442543136f" released by "_create_volume_from_snapshot" :: held 8.988s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.025s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.688s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:10:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-738920918',display_name='tempest-VolumesGetTest-Volume-666433471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:10:52Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Creating volume e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:01 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:01 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb 1073741824 Apr 25 02:11:01 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc5942c-44b3-4d02-9720-8e0fe26b51f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a932278-9481-433d-a6bb-b0442543136f', 'volume_size': 1, 'snapshot_id': 'a49f2dbe-05b7-466d-8eae-e60235c7616a'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8b4c62-a050-4577-b87f-38916bac64b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:01 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Volume volume-7a932278-9481-433d-a6bb-b0442543136f (7a932278-9481-433d-a6bb-b0442543136f): created successfully Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8b4c62-a050-4577-b87f-38916bac64b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Flow 'volume_create_manager' (00171667-11cc-4a26-806b-1ce2a014b193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d1e146fd-b015-489a-9914-8cc0222be46f tempest-VolumesDeleteCascade-1400265833 None] Created volume successfully. Apr 25 02:11:02 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb 1073741824" returned: 0 in 0.787s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:02 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb Apr 25 02:11:02 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-ded8293c-7d95-461f-9a86-e5536d55e3e5-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-ded8293c-7d95-461f-9a86-e5536d55e3e5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Performing cascade delete. {{(pid=81927) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 25 02:11:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-a49f2dbe-05b7-466d-8eae-e60235c7616a-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-a49f2dbe-05b7-466d-8eae-e60235c7616a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-ded8293c-7d95-461f-9a86-e5536d55e3e5" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-ded8293c-7d95-461f-9a86-e5536d55e3e5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-a49f2dbe-05b7-466d-8eae-e60235c7616a" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-a49f2dbe-05b7-466d-8eae-e60235c7616a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Deleting offline snapshot a49f2dbe-05b7-466d-8eae-e60235c7616a of volume ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] snapshot_file for this snap is: volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d134c4aa-b4e7-4560-b1bd-fb8c15539c48]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:03 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb" returned: 0 in 0.637s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721a0d3f-2aac-470c-8a01-981ff9f7be15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15fbd8e-02bf-4234-b8d3-68c0a6f74371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:03 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Volume volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb (e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb): created successfully Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15fbd8e-02bf-4234-b8d3-68c0a6f74371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (18187f5b-b39e-4a56-8c10-3ab01fb0e9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:03 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a Apr 25 02:11:03 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-2e7eab89-ad15-4731-bf59-8eef9bd61c30 tempest-VolumesGetTest-1060268551 None] Created volume successfully. Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=190,cinder:SELECT=153,cinder:INSERT=58,cinder:DELETE=15 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:11:03 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a" returned: 0 in 0.630s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ded8293c-7d95-461f-9a86-e5536d55e3e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ded9772-7546-42f3-9c67-228fc4c88af6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:03 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 Apr 25 02:11:03 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Lock "cinder-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-quobyte-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1b0f37-a84d-40c6-9bf2-cdf306ffe8f3]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:04 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb Apr 25 02:11:04 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:04 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5" returned: 0 in 0.656s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:04 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a Apr 25 02:11:04 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:04 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb" returned: 0 in 0.665s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:04 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb Apr 25 02:11:04 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:05 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a" returned: 0 in 0.786s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:05 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a Apr 25 02:11:05 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:05 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb" returned: 0 in 0.633s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb" released by "delete_volume" :: held 1.341s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Created reservations ['7a29e46d-31ae-4f59-aa51-7d40ad209789', '848a2d1a-875f-4a58-97d5-07d8099122a0', '4cecd6f4-143f-4dac-a078-b151c8d4b7e7', 'a4016adc-0f38-4ec6-aa4f-4c09bdaed257'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:05 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:05 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:05 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5.a49f2dbe-05b7-466d-8eae-e60235c7616a" returned: 0 in 0.576s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-a49f2dbe-05b7-466d-8eae-e60235c7616a" released by "_delete_snapshot" :: held 2.760s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-ded8293c-7d95-461f-9a86-e5536d55e3e5" released by "delete_snapshot" :: held 2.794s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Created reservations ['2e29c312-6624-4803-aabb-c2a371bcb6cc', '94420081-b972-482d-abcd-cec155958b08', 'd6c76af9-adc5-468d-9230-88f4f8d54ed3', 'f9d4525b-a904-47bf-98d2-44063adc631a'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:05 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Delete snapshot completed successfully. Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-a49f2dbe-05b7-466d-8eae-e60235c7616a-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Snapshots deleted, issuing volume delete {{(pid=81927) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-ded8293c-7d95-461f-9a86-e5536d55e3e5" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-ded8293c-7d95-461f-9a86-e5536d55e3e5" acquired by "delete_volume" :: waited 0.033s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0113e0-377f-4b79-9470-ff763ff84cfa]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:06 devstack sudo[87371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 Apr 25 02:11:06 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:06 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.571s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:06 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Deleted volume successfully. Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93f132ee-50fd-4d39-be1b-449aeb7f9e24 tempest-VolumesGetTest-1060268551 None] Lock "cinder-e89cd5eb-ae28-4d68-a5d8-f8d5fb72d0bb-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-dd572509-48ee-4916-a6de-7f9a7a3a70bc-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Lock "cinder-dd572509-48ee-4916-a6de-7f9a7a3a70bc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-quobyte-dd572509-48ee-4916-a6de-7f9a7a3a70bc" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-dd572509-48ee-4916-a6de-7f9a7a3a70bc" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee6f36b-6bbd-475f-821b-f505ac99b6b8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:06 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc Apr 25 02:11:06 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:06 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5" returned: 0 in 0.716s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:06 devstack sudo[87380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5 Apr 25 02:11:06 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:07 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc" returned: 0 in 0.718s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:07 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ded8293c-7d95-461f-9a86-e5536d55e3e5" returned: 0 in 0.603s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:07 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc Apr 25 02:11:07 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-ded8293c-7d95-461f-9a86-e5536d55e3e5" released by "delete_volume" :: held 1.414s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Created reservations ['6b8e3e64-c73f-4f1f-8946-d781b38064a8', 'ab2387e6-ffbc-430e-b6ed-08d014f37a36', 'f72b1e59-d860-400a-9255-b8734f97a4ed', '71353d50-2991-4abc-96d5-ec111652f5f3'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:07 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:07 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:07 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dd572509-48ee-4916-a6de-7f9a7a3a70bc" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-dd572509-48ee-4916-a6de-7f9a7a3a70bc" released by "delete_volume" :: held 1.352s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:07 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Created reservations ['405de06f-609e-4010-afea-36a7a50cf0c1', 'ca4c0dba-55be-445f-b0b9-0640ad553524', 'f69bcbb6-93e2-4ac2-b853-c35001b4747f', '78faa044-a419-4904-a9e1-adb3f3d7c87f'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:08 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:08 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:08 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.722s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:08 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Deleted volume successfully. Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-29130e50-d7f7-400b-9b1d-cf9fa4cd315c tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-ded8293c-7d95-461f-9a86-e5536d55e3e5-delete_volume" released by "delete_volume" :: held 5.442s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-7a932278-9481-433d-a6bb-b0442543136f-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-7a932278-9481-433d-a6bb-b0442543136f-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "cinder-quobyte-7a932278-9481-433d-a6bb-b0442543136f" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-7a932278-9481-433d-a6bb-b0442543136f" acquired by "delete_volume" :: waited 0.071s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac42630-fcae-498d-9adc-a4da5f9bcfb1]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:09 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f Apr 25 02:11:09 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:09 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4135ae90-2832-4c8b-a1b7-ee952dc0f602 tempest-GroupSnapshotsTest-8609387 None] Group tempest-GroupSnapshotsTest-Group-1170848685: creating Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (ff12fb3b-9aa0-4cf8-9bcd-736dfbd2b18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a51720-ae0f-4490-88a6-a9f6bdaecf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:09 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:09 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4135ae90-2832-4c8b-a1b7-ee952dc0f602 tempest-GroupSnapshotsTest-8609387 None] Group tempest-GroupSnapshotsTest-Group-1170848685: created successfully Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.597s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a51720-ae0f-4490-88a6-a9f6bdaecf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2138241217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f64283-37f7-461a-9153-6df2608457bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:10Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1d5369-41fb-4819-bb13-55ab69f49f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1d5369-41fb-4819-bb13-55ab69f49f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eae98dd-28ea-4abf-a848-cbb0d5e960fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eae98dd-28ea-4abf-a848-cbb0d5e960fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f64283-37f7-461a-9153-6df2608457bd', 'volume_name': 'volume-53f64283-37f7-461a-9153-6df2608457bd', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01f3535-fa4a-40de-b6fb-1d7ad85358f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01f3535-fa4a-40de-b6fb-1d7ad85358f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f43881-87ab-43d5-85c9-b2647bbbc8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:09 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Volume 53f64283-37f7-461a-9153-6df2608457bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f64283-37f7-461a-9153-6df2608457bd', 'volume_size': 1} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2138241217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f64283-37f7-461a-9153-6df2608457bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:10Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Creating volume 53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:09 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:09 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:09 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Deleted volume successfully. Apr 25 02:11:09 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd 1073741824 Apr 25 02:11:09 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:09 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4135ae90-2832-4c8b-a1b7-ee952dc0f602 tempest-GroupSnapshotsTest-8609387 None] Create group completed successfully. Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f" returned: 0 in 0.815s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:09 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eae4f399-69cb-4a63-ad12-f97867e70715 tempest-VolumesGetTest-1060268551 None] Lock "cinder-dd572509-48ee-4916-a6de-7f9a7a3a70bc-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:09 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f Apr 25 02:11:09 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:10 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7a932278-9481-433d-a6bb-b0442543136f" returned: 0 in 0.641s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-quobyte-7a932278-9481-433d-a6bb-b0442543136f" released by "delete_volume" :: held 1.546s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Created reservations ['adcb441e-0d50-471c-98e5-7cf29f8688e7', 'a3b4425c-5a07-4b71-bd27-764b822ba6aa', 'bd594479-bad4-46eb-abd9-6b07c93043de', '087cf7ba-b246-4c99-abe7-694959ae4c5b'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:10 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd 1073741824" returned: 0 in 0.884s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:10 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:10 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:10 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd Apr 25 02:11:10 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:11 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:11 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Flow 'volume_create_manager' (7d00d86b-c46c-434a-aedb-e5a8c251045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d122d0ef-3b65-446e-ad65-9274b4d93db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d122d0ef-3b65-446e-ad65-9274b4d93db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507359416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0beb16b-6169-4238-9bb7-63dee988b42c,host='devstack@QuobyteHD#QuobyteHD',id=9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce29fd71c843e29eebe40ad4284e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:11Z,use_quota=True,user_id='f17217b516e544f1b273c06c7e86bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f393e7f2-5dbd-4635-b243-ce12be93341e),volume_type_id=f393e7f2-5dbd-4635-b243-ce12be93341e)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf81d7a-a36f-48ce-b0ea-f647d614fcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bf81d7a-a36f-48ce-b0ea-f647d614fcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af13460f-79b2-4dae-8124-f0c3160cf256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af13460f-79b2-4dae-8124-f0c3160cf256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f', 'volume_name': 'volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0decb96-762d-45e3-aa01-23845c501811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0decb96-762d-45e3-aa01-23845c501811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a479a3-cc77-4404-bd05-f86201bd15b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:11 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Volume 9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f', 'volume_size': 1} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:11 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.161s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:11 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Deleted volume successfully. Apr 25 02:11:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-469fc540-fb59-4640-ad1a-92980da85909 tempest-VolumesDeleteCascade-1400265833 None] Lock "cinder-7a932278-9481-433d-a6bb-b0442543136f-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:12 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.893s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:12 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd" returned: 0 in 1.529s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] <== create_volume: return (2490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b0beb16b-6169-4238-9bb7-63dee988b42c,created_at=2026-04-25T00:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507359416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0beb16b-6169-4238-9bb7-63dee988b42c,host='devstack@QuobyteHD#QuobyteHD',id=9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce29fd71c843e29eebe40ad4284e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:11Z,use_quota=True,user_id='f17217b516e544f1b273c06c7e86bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f393e7f2-5dbd-4635-b243-ce12be93341e),volume_type_id=f393e7f2-5dbd-4635-b243-ce12be93341e)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Creating volume 9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:12 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f43881-87ab-43d5-85c9-b2647bbbc8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f64283-37f7-461a-9153-6df2608457bd', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7b612d-b62e-4fbf-9999-81970bab6cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:12 devstack sudo[87466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f 1073741824 Apr 25 02:11:12 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:12 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Volume volume-53f64283-37f7-461a-9153-6df2608457bd (53f64283-37f7-461a-9153-6df2608457bd): created successfully Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7b612d-b62e-4fbf-9999-81970bab6cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (ff12fb3b-9aa0-4cf8-9bcd-736dfbd2b18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:12 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d0a98b66-9fbf-4091-9674-2fbee82a12ec tempest-VolumesGetTest-1060268551 None] Created volume successfully. Apr 25 02:11:13 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f 1073741824" returned: 0 in 0.843s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:13 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f Apr 25 02:11:13 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (57aaddc7-461d-4f44-802a-f15d033ca61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfc3ff3-3370-4536-88bb-ff222073b3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfc3ff3-3370-4536-88bb-ff222073b3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2103845398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb37cbc2-4c96-4ae9-9e42-e206b5edb000,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=53f64283-37f7-461a-9153-6df2608457bd,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:14Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c05ece3-5e02-4425-9515-3a18f73de846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c05ece3-5e02-4425-9515-3a18f73de846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864c8101-6576-4e9c-aaf3-562013bf547a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864c8101-6576-4e9c-aaf3-562013bf547a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fb37cbc2-4c96-4ae9-9e42-e206b5edb000', 'volume_name': 'volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000', 'volume_size': 1, 'source_volid': '53f64283-37f7-461a-9153-6df2608457bd', 'source_volstatus': 'available'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88743cb4-649b-407c-8f10-b6ae8d66d557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88743cb4-649b-407c-8f10-b6ae8d66d557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6162d030-3964-4093-afba-2960ecece393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:14 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Volume fb37cbc2-4c96-4ae9-9e42-e206b5edb000: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000', 'volume_size': 1, 'source_volid': '53f64283-37f7-461a-9153-6df2608457bd', 'source_volstatus': 'available'} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:14 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" returned: 0 in 0.847s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.028s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:14 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Cloning volume 53f64283-37f7-461a-9153-6df2608457bd to volume fb37cbc2-4c96-4ae9-9e42-e206b5edb000 Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a479a3-cc77-4404-bd05-f86201bd15b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac285a6f-433b-4f07-9cff-7dab6174d51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Creating offline snapshot 455f932f-8fa8-4621-aa6e-f33e945a81ac of volume 53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:11:14 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Volume volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f (9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f): created successfully Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac285a6f-433b-4f07-9cff-7dab6174d51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Flow 'volume_create_manager' (7d00d86b-c46c-434a-aedb-e5a8c251045f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eadffa-90ad-4067-961f-0aa1259f5aa8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:14 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-519e67d6-bea8-49cf-b139-be5b4ce73ca8 tempest-GroupSnapshotsTest-8609387 None] Created volume successfully. Apr 25 02:11:14 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd Apr 25 02:11:14 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:14 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd" returned: 0 in 0.612s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:14 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac 1G Apr 25 02:11:14 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:15 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] GroupSnapshot ba0d4d12-f9ac-4227-82c7-8178b4cd6ba9: creating. Apr 25 02:11:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Group snapshot ba0d4d12-f9ac-4227-82c7-8178b4cd6ba9: creating. {{(pid=81927) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 25 02:11:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:15 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac 1G" returned: 0 in 0.869s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f64283-37f7-461a-9153-6df2608457bd -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:15 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f64283-37f7-461a-9153-6df2608457bd -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac Apr 25 02:11:15 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:16 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53f64283-37f7-461a-9153-6df2608457bd -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac" returned: 0 in 0.553s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:16 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac is being set with open permissions: ugo+rw Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:16 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac Apr 25 02:11:16 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Flow 'volume_create_manager' (632a0460-7db6-4be1-a34b-efeb4d9075ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43e684-e4a7-44ce-bf09-7942cc4e6dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43e684-e4a7-44ce-bf09-7942cc4e6dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1464553294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a938c1e0-9178-46eb-8a91-585be645f713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe6d6b6bf12464a848c282a59541143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:17Z,use_quota=True,user_id='4af848bf10034b0e946bb7ff26bb3891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62ef6d2-ce94-415b-a1e1-ee712ba20878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:16 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62ef6d2-ce94-415b-a1e1-ee712ba20878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f68103-49d2-4d2d-8e80-aac991286181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f68103-49d2-4d2d-8e80-aac991286181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a938c1e0-9178-46eb-8a91-585be645f713', 'volume_name': 'volume-a938c1e0-9178-46eb-8a91-585be645f713', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d569df65-994b-4cc6-a654-03e2b8acc9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d569df65-994b-4cc6-a654-03e2b8acc9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed46727f-0a26-4f51-bbe9-aa22ff1447cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:16 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Volume a938c1e0-9178-46eb-8a91-585be645f713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a938c1e0-9178-46eb-8a91-585be645f713', 'volume_size': 1} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac" returned: 0 in 0.600s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:16 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.info Apr 25 02:11:16 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:17 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.info" returned: 0 in 0.439s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:17 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.info is being set with open permissions: ugo+rw Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:17 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.info Apr 25 02:11:17 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:17 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.info" returned: 0 in 0.429s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-quobyte-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] snapshot: 455f932f-8fa8-4621-aa6e-f33e945a81ac, volume: fb37cbc2-4c96-4ae9-9e42-e206b5edb000, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[519fbd5c-e3b6-413d-ab21-50426666c7ee]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:17 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac Apr 25 02:11:17 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:18 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac" returned: 0 in 0.537s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f64283-37f7-461a-9153-6df2608457bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:11:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:11:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:11:18 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6ef740-49a7-48fc-99bb-8a53844f499b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:18 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd Apr 25 02:11:18 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:18 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd" returned: 0 in 0.554s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:18 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:11:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:18 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 Apr 25 02:11:18 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:24 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" returned: 0 in 5.283s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:24 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[86896715-da67-4a73-b99b-b3fe85624a95]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:24 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd Apr 25 02:11:24 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:24 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd" returned: 0 in 0.683s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:24 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:11:24 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Converted 1024.00 MB image at 193.74 MB/s Apr 25 02:11:24 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 is being set with open permissions: ugo+rw Apr 25 02:11:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:24 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 Apr 25 02:11:24 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:25 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" returned: 0 in 0.494s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" released by "_copy_volume_from_snapshot" :: held 7.638s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-quobyte-455f932f-8fa8-4621-aa6e-f33e945a81ac" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-455f932f-8fa8-4621-aa6e-f33e945a81ac" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Deleting offline snapshot 455f932f-8fa8-4621-aa6e-f33e945a81ac of volume 53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:11:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] snapshot_file for this snap is: volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:11:25 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ccb172-055b-4e5a-80c2-a33cca463c25]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:25 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac Apr 25 02:11:25 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:26 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac" returned: 0 in 0.561s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53f64283-37f7-461a-9153-6df2608457bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c7073a-65a5-4a8a-af36-11212a0fab7c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:26 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd Apr 25 02:11:26 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:26 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd" returned: 0 in 0.566s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:26 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac Apr 25 02:11:26 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Acquiring lock "cinder-bf77a74c-449e-4860-b975-da0f6b8d492e-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Lock "cinder-bf77a74c-449e-4860-b975-da0f6b8d492e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Acquiring lock "cinder-quobyte-bf77a74c-449e-4860-b975-da0f6b8d492e" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Lock "cinder-quobyte-bf77a74c-449e-4860-b975-da0f6b8d492e" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[75874bce-0a60-4971-8e63-e69dc3685a19]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:26 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e Apr 25 02:11:26 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:27 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac" returned: 0 in 0.564s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:27 devstack sudo[87616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac Apr 25 02:11:27 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:27 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e" returned: 0 in 0.556s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:27 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e Apr 25 02:11:27 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:27 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd.455f932f-8fa8-4621-aa6e-f33e945a81ac" returned: 0 in 0.447s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-455f932f-8fa8-4621-aa6e-f33e945a81ac" released by "_delete_snapshot" :: held 2.247s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.633s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.229s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6162d030-3964-4093-afba-2960ecece393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000', 'volume_size': 1, 'source_volid': '53f64283-37f7-461a-9153-6df2608457bd', 'source_volstatus': 'available'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe84b92-2d3f-40c9-aead-28b161f27bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Creating offline snapshot cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f of volume 9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:11:27 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Volume volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 (fb37cbc2-4c96-4ae9-9e42-e206b5edb000): created successfully Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe84b92-2d3f-40c9-aead-28b161f27bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (57aaddc7-461d-4f44-802a-f15d033ca61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a3bf75-10bc-4bb7-8c62-48611add765f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:27 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-8987d34b-8840-4cfe-a767-3e8d0b5cd0bf tempest-VolumesGetTest-1060268551 None] Created volume successfully. Apr 25 02:11:27 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f Apr 25 02:11:27 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:27 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bf77a74c-449e-4860-b975-da0f6b8d492e" returned: 0 in 0.494s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Lock "cinder-quobyte-bf77a74c-449e-4860-b975-da0f6b8d492e" released by "delete_volume" :: held 1.090s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:27 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Created reservations ['63e50650-c055-4fd0-8f96-309ca3f464ed', 'fbf469db-fd91-4553-ac34-80754cf98085', '5cc04912-7cdb-47f8-94a9-e3385c5305a4', '7ffa6406-af10-427b-ad64-30d9e179dbf8'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:28 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:28 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:28 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" returned: 0 in 0.571s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:28 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f 1G Apr 25 02:11:28 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:28 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.446s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Deleted volume successfully. Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-10771472-a7c6-478e-913b-853cd64e2679 tempest-VolumesNegativeTest-217153213 None] Lock "cinder-bf77a74c-449e-4860-b975-da0f6b8d492e-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:28 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f 1G" returned: 0 in 0.631s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:28 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f Apr 25 02:11:28 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (6996bf83-d505-4b31-ba68-d20891cbc044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cb1852-b382-4655-ab02-5c47bf05b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:29 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03cb1852-b382-4655-ab02-5c47bf05b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-691234683',display_name='tempest-VolumesGetTest-Volume-932464895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:29Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386acf34-3bdd-4122-a454-02aaff99ccbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386acf34-3bdd-4122-a454-02aaff99ccbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0179ce-831b-43ed-b1be-ecfc8c743223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0179ce-831b-43ed-b1be-ecfc8c743223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6', 'volume_name': 'volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44824bd-444e-4a42-a272-5b5600097eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44824bd-444e-4a42-a272-5b5600097eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2082271-c391-4630-b3a6-16f592d7feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Volume fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6', 'volume_size': 1} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f" returned: 0 in 0.662s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:29 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:11:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:29 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f Apr 25 02:11:29 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:30 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f" returned: 0 in 0.520s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:30 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.info Apr 25 02:11:30 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:30 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.info" returned: 0 in 0.437s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:30 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:11:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:30 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.info Apr 25 02:11:30 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:31 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.info" returned: 0 in 0.425s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.371s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.268s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1464553294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a938c1e0-9178-46eb-8a91-585be645f713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe6d6b6bf12464a848c282a59541143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:17Z,use_quota=True,user_id='4af848bf10034b0e946bb7ff26bb3891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Creating volume a938c1e0-9178-46eb-8a91-585be645f713 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:31 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:31 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713 1073741824 Apr 25 02:11:31 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-58f7c133-3e0d-4ffe-b1e6-bf46518e3857 tempest-GroupSnapshotsTest-8609387 None] group_snapshot ba0d4d12-f9ac-4227-82c7-8178b4cd6ba9: created successfully Apr 25 02:11:31 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713 1073741824" returned: 0 in 0.652s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:31 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713 Apr 25 02:11:31 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:32 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713" returned: 0 in 0.463s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.602s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-691234683',display_name='tempest-VolumesGetTest-Volume-932464895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:29Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Creating volume fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:32 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed46727f-0a26-4f51-bbe9-aa22ff1447cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a938c1e0-9178-46eb-8a91-585be645f713', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:32 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 1073741824 Apr 25 02:11:32 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58149db-afa0-4811-8b8e-a795eff7a08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:32 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Volume volume-a938c1e0-9178-46eb-8a91-585be645f713 (a938c1e0-9178-46eb-8a91-585be645f713): created successfully Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58149db-afa0-4811-8b8e-a795eff7a08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Flow 'volume_create_manager' (632a0460-7db6-4be1-a34b-efeb4d9075ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:32 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-641a5e9d-0f50-4bea-9eb6-79be4ff24507 tempest-VolumesTransfersTest-476141283 None] Created volume successfully. Apr 25 02:11:32 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 1073741824" returned: 0 in 0.661s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:32 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 Apr 25 02:11:32 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:33 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6" returned: 0 in 0.511s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.284s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" by "_create_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2082271-c391-4630-b3a6-16f592d7feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f567e9-78e0-4925-aed6-6e039075894b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:33 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Volume volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 (fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6): created successfully Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f567e9-78e0-4925-aed6-6e039075894b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (6996bf83-d505-4b31-ba68-d20891cbc044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Creating volume cf49de0f-7af4-4a69-8dd8-d295fa4b14bf from snapshot cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f {{(pid=81927) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:33 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d68d0fd8-b758-4253-b8d0-0508868b035e tempest-VolumesGetTest-1060268551 None] Created volume successfully. Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] snapshot: cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f, volume: cf49de0f-7af4-4a69-8dd8-d295fa4b14bf, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:33 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-560726a9-aecb-48ed-a863-f6de0ed8fd31 tempest-VolumesTransfersTest-516199313 None] Transfer volume completed successfully. Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c29ecd3-8476-487d-970b-392b4eb479c9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:33 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f Apr 25 02:11:33 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Lock "cinder-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-quobyte-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6" acquired by "delete_volume" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[1699b9dc-932e-49cd-a175-9f412ef4291f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:34 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 Apr 25 02:11:34 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:34 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f" returned: 0 in 0.604s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7e3241-50ed-431c-9e33-6cd5c7092686]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:34 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f Apr 25 02:11:34 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Acquiring lock "cinder-a938c1e0-9178-46eb-8a91-585be645f713-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Lock "cinder-a938c1e0-9178-46eb-8a91-585be645f713-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Acquiring lock "cinder-quobyte-a938c1e0-9178-46eb-8a91-585be645f713" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Lock "cinder-quobyte-a938c1e0-9178-46eb-8a91-585be645f713" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe86616-4900-4508-9852-dd1f7cc578d9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:34 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6" returned: 0 in 0.664s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:34 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6 Apr 25 02:11:34 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:34 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713 Apr 25 02:11:34 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:34 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" returned: 0 in 0.616s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:11:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:34 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf Apr 25 02:11:34 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:35 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6" returned: 0 in 0.479s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6" released by "delete_volume" :: held 1.185s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:35 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713" returned: 0 in 0.531s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:35 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713 Apr 25 02:11:35 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Created reservations ['0fba3138-1486-41e1-81a0-5696468cd2be', '25cd9d09-e220-4dce-b21d-0c1f18024341', '59a4f803-e41c-4032-9111-5941819a376f', '58fac461-3915-42b8-ab2c-e1b27ee64b72'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:35 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:35 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:35 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a938c1e0-9178-46eb-8a91-585be645f713" returned: 0 in 0.833s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Lock "cinder-quobyte-a938c1e0-9178-46eb-8a91-585be645f713" released by "delete_volume" :: held 1.408s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Created reservations ['cbbe6d00-266d-4b76-8a4f-72c5ce0cac18', 'd4d31d73-81c5-40c8-8add-7d5cb4066ea6', '3a28c87b-9016-4a73-abf9-392890f56268', '7c21f407-6082-41f0-a2d7-eb70c4559e11'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:36 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:36 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-fb37cbc2-4c96-4ae9-9e42-e206b5edb000-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Lock "cinder-fb37cbc2-4c96-4ae9-9e42-e206b5edb000-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-quobyte-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" acquired by "delete_volume" :: waited 0.031s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[129a81b4-4558-4ba5-9310-2ab95478c277]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:36 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.509s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:36 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Deleted volume successfully. Apr 25 02:11:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e67fab75-63c1-440a-8ad6-dd8909b3a0be tempest-VolumesGetTest-1060268551 None] Lock "cinder-fd3fd7e3-4197-4f3c-a6f0-b4ee999a7de6-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:36 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 Apr 25 02:11:36 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:37 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.859s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:37 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:37 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Deleted volume successfully. Apr 25 02:11:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15501111-6ca4-4653-9485-a80ef1650ac5 tempest-VolumesTransfersTest-601870487 None] Lock "cinder-a938c1e0-9178-46eb-8a91-585be645f713-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:37 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" returned: 0 in 1.273s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:38 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000 Apr 25 02:11:38 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Flow 'volume_create_manager' (70513bf1-c867-4696-be55-c1349caa92df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1147ce2f-af57-4d53-8d77-57e3735be3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1147ce2f-af57-4d53-8d77-57e3735be3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1914494440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a81d33-5a77-4067-9f16-d2ea6fb45927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe6d6b6bf12464a848c282a59541143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:38Z,use_quota=True,user_id='4af848bf10034b0e946bb7ff26bb3891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f185621-e6fc-4f73-a644-28f19cfff41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f185621-e6fc-4f73-a644-28f19cfff41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f237884-16a4-4a47-ad71-f84a512fea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f237884-16a4-4a47-ad71-f84a512fea35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a81d33-5a77-4067-9f16-d2ea6fb45927', 'volume_name': 'volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc94f80-ca7f-479b-b9cd-72f63c61afe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc94f80-ca7f-479b-b9cd-72f63c61afe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd85aa7-2d3e-4102-87bf-483f8d155607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:38 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Volume b5a81d33-5a77-4067-9f16-d2ea6fb45927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927', 'volume_size': 1} Apr 25 02:11:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:39 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" returned: 0 in 1.225s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-fb37cbc2-4c96-4ae9-9e42-e206b5edb000" released by "delete_volume" :: held 2.601s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:39 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Created reservations ['32f533fc-c113-42b7-872f-df60296fcad8', 'bf6de4d0-bd77-40ab-be87-dbfa85d51e3a', '3cdc02d3-3cba-4201-a600-28e32b0b55d9', 'eadd003a-aa41-4a92-bd61-88b172091822'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:39 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:39 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-53f64283-37f7-461a-9153-6df2608457bd-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Lock "cinder-53f64283-37f7-461a-9153-6df2608457bd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=128,cinder:INSERT=43,cinder:UPDATE=182,cinder:DELETE=15 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-quobyte-53f64283-37f7-461a-9153-6df2608457bd" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-53f64283-37f7-461a-9153-6df2608457bd" acquired by "delete_volume" :: waited 0.066s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:40 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.932s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:40 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Deleted volume successfully. Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d151008-af04-49a3-8fea-bbac61aae930]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5e012aa1-f013-4b53-b16d-a3033d63984d tempest-VolumesGetTest-1060268551 None] Lock "cinder-fb37cbc2-4c96-4ae9-9e42-e206b5edb000-delete_volume" released by "delete_volume" :: held 3.993s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:40 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:40 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd Apr 25 02:11:40 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" returned: 0 in 5.682s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d40c1f-4bf9-4a20-9479-0dcd990a600e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:40 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f Apr 25 02:11:40 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:40 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd" returned: 0 in 0.532s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:40 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd Apr 25 02:11:40 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:41 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" returned: 0 in 0.652s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:11:41 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Converted 1024.00 MB image at 180.19 MB/s Apr 25 02:11:41 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:41 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf Apr 25 02:11:41 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:41 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-53f64283-37f7-461a-9153-6df2608457bd" returned: 0 in 0.432s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-53f64283-37f7-461a-9153-6df2608457bd" released by "delete_volume" :: held 1.113s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Created reservations ['fb3ce0a9-b29e-4e7b-8ee7-fce143e35632', '6fc27353-ac42-4d72-8d9a-95f353939ee0', 'bf9b79c0-0f42-4e9a-9776-426e2928f3e1', 'dcbbd1b9-0fa4-4577-9a78-c3badbe257f8'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:41 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:41 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:41 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" returned: 0 in 0.478s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" released by "_copy_volume_from_snapshot" :: held 8.134s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" released by "_create_volume_from_snapshot" :: held 8.180s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.216s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.442s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1914494440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a81d33-5a77-4067-9f16-d2ea6fb45927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbe6d6b6bf12464a848c282a59541143',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:38Z,use_quota=True,user_id='4af848bf10034b0e946bb7ff26bb3891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Creating volume b5a81d33-5a77-4067-9f16-d2ea6fb45927 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:41 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:41 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 1073741824 Apr 25 02:11:41 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:41 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-fa678cbc-4443-49c8-a8dd-ed831310ae90 tempest-GroupSnapshotsTest-8609387 None] Create group from source-snapshot-ba0d4d12-f9ac-4227-82c7-8178b4cd6ba9 completed successfully. Apr 25 02:11:41 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.453s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:41 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:41 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Deleted volume successfully. Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0274d9d3-4ea6-44f2-93b6-47577055cc6d tempest-VolumesGetTest-1060268551 None] Lock "cinder-53f64283-37f7-461a-9153-6df2608457bd-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:42 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 1073741824" returned: 0 in 0.618s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:42 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 Apr 25 02:11:42 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:42 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927" returned: 0 in 0.546s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dd85aa7-2d3e-4102-87bf-483f8d155607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cc6b1f-24c5-400d-b88b-0d7290b93d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:42 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Volume volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 (b5a81d33-5a77-4067-9f16-d2ea6fb45927): created successfully Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44cc6b1f-24c5-400d-b88b-0d7290b93d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Flow 'volume_create_manager' (70513bf1-c867-4696-be55-c1349caa92df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (c3ab8732-5ba1-44de-800a-47022cf0e708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff0a19b-4303-425c-97f6-f3c92d53f4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:42 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-960a342f-32dd-4f80-b4c5-6a0256ae87bb tempest-VolumesTransfersTest-476141283 None] Created volume successfully. Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" acquired by "delete_volume" :: waited 0.045s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff0a19b-4303-425c-97f6-f3c92d53f4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-566143846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196c611f-2a29-4b9f-a2c9-522909590916,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:43Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ff2583-d6f3-46ef-b56e-ddfa90aaf000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ff2583-d6f3-46ef-b56e-ddfa90aaf000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbc2e88-1117-46ee-8bc1-0318f1404b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.image.glance [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Creating Keystone auth plugin from conf {{(pid=81927) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[c688b43d-ad3f-410f-8138-baeabb0c74d9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:43 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf Apr 25 02:11:43 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbc2e88-1117-46ee-8bc1-0318f1404b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '196c611f-2a29-4b9f-a2c9-522909590916', 'volume_name': 'volume-196c611f-2a29-4b9f-a2c9-522909590916', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5241d35-1c8b-402b-8bf7-be65191985cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5241d35-1c8b-402b-8bf7-be65191985cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3256fc7d-e339-49ba-949c-98dd9f0db73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:43 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Volume 196c611f-2a29-4b9f-a2c9-522909590916: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-196c611f-2a29-4b9f-a2c9-522909590916', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Trying to clone 196c611f-2a29-4b9f-a2c9-522909590916 from image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]). {{(pid=81927) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Acquiring lock "cinder-b5a81d33-5a77-4067-9f16-d2ea6fb45927-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Lock "cinder-b5a81d33-5a77-4067-9f16-d2ea6fb45927-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Acquiring lock "cinder-quobyte-b5a81d33-5a77-4067-9f16-d2ea6fb45927" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Lock "cinder-quobyte-b5a81d33-5a77-4067-9f16-d2ea6fb45927" acquired by "delete_volume" :: waited 0.028s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b262cc-8228-4916-9884-b0718230d2ca]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:43 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" returned: 0 in 0.671s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:43 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf Apr 25 02:11:43 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:43 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 25 02:11:43 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Image download 20.69 MB at 20.69 MB/s Apr 25 02:11:43 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5f2c4d-ff64-4f8a-9f85-7f2e59f9e641]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:43 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD Apr 25 02:11:43 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:44 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" returned: 0 in 0.462s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-cf49de0f-7af4-4a69-8dd8-d295fa4b14bf" released by "delete_volume" :: held 1.189s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:44 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927" returned: 0 in 0.555s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:44 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927 Apr 25 02:11:44 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['030f8eaf-74fe-4b36-b8c5-1e8b1e95cb13'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:44 devstack cinder-volume[81927]: WARNING cinder.quota [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-602490139 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-602490139, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:11:44 devstack cinder-volume[81927]: WARNING cinder.quota [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-602490139 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-602490139, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['e75d7392-55aa-4ab2-b00e-c1f01e63c976', '88785632-beff-4443-87d0-0b7140d26eea', 'a23626fc-a57b-465b-be68-bfcf221a5483', '24d30c53-3f1b-4a11-a7d1-cef4c995a46d'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:44 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD" returned: 0 in 0.524s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Temporary image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 is fetched for user 21f734df51f3463f9560532c05955170. {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7825cfbd-6ac9-4bf3-b1bf-5fd5d132ed54]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:44 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:44 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:44 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD Apr 25 02:11:44 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:44 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b5a81d33-5a77-4067-9f16-d2ea6fb45927" returned: 0 in 0.473s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Lock "cinder-quobyte-b5a81d33-5a77-4067-9f16-d2ea6fb45927" released by "delete_volume" :: held 1.072s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Created reservations ['686266db-a179-4fe9-a321-7206831e4cac', '44c53276-80c2-403b-9bfe-5e4c4548aa80', '8446437b-c29b-4422-9962-8126c6f4edfb', '69c77823-4ac8-48b8-9fd6-df4d470a5eb5'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:44 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:44 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:44 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.453s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:44 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d5be0e9f-6fab-488f-867b-84921732cc42 tempest-GroupSnapshotsTest-8609387 None] Delete group completed successfully. Apr 25 02:11:44 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD" returned: 0 in 0.547s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-566143846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196c611f-2a29-4b9f-a2c9-522909590916,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:43Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Creating volume 196c611f-2a29-4b9f-a2c9-522909590916 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:45 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:45 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 1073741824 Apr 25 02:11:45 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:45 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] group_snapshot ba0d4d12-f9ac-4227-82c7-8178b4cd6ba9: deleting Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] group_snapshot ba0d4d12-f9ac-4227-82c7-8178b4cd6ba9: deleting {{(pid=81927) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Deleting offline snapshot cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f of volume 9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] snapshot_file for this snap is: volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[c735c6d2-3f60-4431-8262-48df4cc101f0]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:45 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.501s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:45 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Deleted volume successfully. Apr 25 02:11:45 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f Apr 25 02:11:45 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d5a5c836-002e-494a-9b88-4d504694b888 tempest-VolumesTransfersTest-601870487 None] Lock "cinder-b5a81d33-5a77-4067-9f16-d2ea6fb45927-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:45 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 1073741824" returned: 0 in 0.687s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:45 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 Apr 25 02:11:45 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:45 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f" returned: 0 in 0.583s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbcd31f-0ab3-4f59-b940-158633300acc]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:45 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f Apr 25 02:11:45 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:46 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916" returned: 0 in 0.500s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Attempting download of ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}])) to volume 196c611f-2a29-4b9f-a2c9-522909590916. {{(pid=81927) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2848cdeb-5eb0-42ff-b6ae-aa5e6e547383]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_plhp00vo {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:46 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_plhp00vo Apr 25 02:11:46 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:46 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" returned: 0 in 0.682s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:46 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f Apr 25 02:11:46 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:46 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_plhp00vo" returned: 0 in 0.567s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_plhp00vo {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:46 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_plhp00vo Apr 25 02:11:46 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:47 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f" returned: 0 in 0.657s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:47 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f Apr 25 02:11:47 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:47 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_plhp00vo" returned: 1 in 0.554s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_plhp00vo' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcb2f33-db95-4e60-91c4-4801130162dc]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:47 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD Apr 25 02:11:47 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:47 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f.cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f" returned: 0 in 0.533s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-cc5a7cf0-d568-4d40-b5ac-f4f0389a5e1f" released by "_delete_snapshot" :: held 2.557s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" released by "delete_snapshot" :: held 2.591s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:47 devstack cinder-volume[81927]: WARNING cinder.quota [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-602490139 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-602490139, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] Created reservations ['1e38fbba-416f-491d-b572-77880c970a22', 'fb447c3a-8fa4-441d-b148-149a5fbdd7b3', '60e16468-5e1e-4081-87d3-1f6c3931ed64', '1e868c43-c84a-4360-bc17-ba2e5caa8638'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:47 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD" returned: 0 in 0.546s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 was qcow2, converting to raw {{(pid=81927) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 25 02:11:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:48 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 Apr 25 02:11:48 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5067219e-d868-41e4-b469-e7c6c4c2471b tempest-GroupSnapshotsTest-8609387 None] group_snapshot ba0d4d12-f9ac-4227-82c7-8178b4cd6ba9: deleted successfully Apr 25 02:11:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:48 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7fee7e-2d3b-4857-bdde-ad9c2dcc7ae3]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:48 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f Apr 25 02:11:48 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:49 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" returned: 0 in 0.732s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:49 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f Apr 25 02:11:49 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:49 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916" returned: 0 in 1.544s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:49 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ddf958f3-70cd-4c7a-bcfa-1b0faf68d852_v_uc74x0devstack@QuobyteHD, size 112.00 MB, duration 1.55 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:11:49 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Converted 112.00 MB image at 72.44 MB/s Apr 25 02:11:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:49 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 1G Apr 25 02:11:49 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:50 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" returned: 0 in 0.523s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-9bd21bbf-6c5d-4f44-b046-72dd5fea6d3f" released by "delete_volume" :: held 1.343s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:50 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 1G" returned: 0 in 0.545s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['b7f69455-7605-4866-bf51-f959df85e563'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7b3236-1429-429c-8a0d-b1316776ca78]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:50 devstack cinder-volume[81927]: WARNING cinder.db.sqlalchemy.api [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-602490139'] Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['8502576c-a280-43c2-a6e8-8df7b5503b57', 'ad18a03a-d33a-44f6-9666-6c34f80efbde', '7eb493e9-8e51-46be-b4b9-4592240b168a', '35cfefa6-953a-4eac-b953-9ae675f47ad9'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:50 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 Apr 25 02:11:50 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:50 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:50 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:50 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916" returned: 0 in 0.641s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:50 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.517s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:50 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:50 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c0de25fe-7fc6-4aaf-a264-5a6c5ada8539 tempest-GroupSnapshotsTest-8609387 None] Delete group completed successfully. Apr 25 02:11:50 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 Apr 25 02:11:50 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:51 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dcd151e6-dde8-461d-a397-2b773ec38089 tempest-GroupSnapshotsTest-8609387 None] Group tempest-GroupSnapshotsTest-Group-1606355905: creating Apr 25 02:11:51 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916" returned: 1 in 0.591s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Downloaded image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}])) to volume 196c611f-2a29-4b9f-a2c9-522909590916 successfully. {{(pid=81927) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Temporary image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 for user 21f734df51f3463f9560532c05955170 is deleted. {{(pid=81927) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG cinder.volume.volume_utils [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Marking volume 196c611f-2a29-4b9f-a2c9-522909590916 as bootable. {{(pid=81927) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Copying metadata from image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 to 196c611f-2a29-4b9f-a2c9-522909590916. {{(pid=81927) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Creating volume glance metadata for volume 196c611f-2a29-4b9f-a2c9-522909590916 backed by image ddf958f3-70cd-4c7a-bcfa-1b0faf68d852 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81927) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 25 02:11:51 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dcd151e6-dde8-461d-a397-2b773ec38089 tempest-GroupSnapshotsTest-8609387 None] Group tempest-GroupSnapshotsTest-Group-1606355905: created successfully Apr 25 02:11:51 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dcd151e6-dde8-461d-a397-2b773ec38089 tempest-GroupSnapshotsTest-8609387 None] Create group completed successfully. Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3256fc7d-e339-49ba-949c-98dd9f0db73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196c611f-2a29-4b9f-a2c9-522909590916', 'volume_size': 1, 'image_id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c38d493d65ee45c7b1d2b568c53b609f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ddf958f3-70cd-4c7a-bcfa-1b0faf68d852', 'created_at': datetime.datetime(2026, 4, 25, 0, 1, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 0, 1, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddf958f3-70cd-4c7a-bcfa-1b0faf68d852/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ffa037-6758-45ea-bd2a-e15dfc6e29da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Volume volume-196c611f-2a29-4b9f-a2c9-522909590916 (196c611f-2a29-4b9f-a2c9-522909590916): created successfully Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ffa037-6758-45ea-bd2a-e15dfc6e29da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (c3ab8732-5ba1-44de-800a-47022cf0e708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:51 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3d2880ca-c92c-4454-b98e-8c66171e161c tempest-VolumesGetTest-1060268551 None] Created volume successfully. Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Flow 'volume_create_manager' (ed91e508-4020-4e1e-9ba3-d2d4deeecdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2359f8-c014-4527-acd6-0f56c2fbc444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2359f8-c014-4527-acd6-0f56c2fbc444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-180272049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be3790e-cb7c-4444-b8e0-940dc6fc6193,host='devstack@QuobyteHD#QuobyteHD',id=1ee14bdb-94e6-4300-a68f-8d13120a37f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce29fd71c843e29eebe40ad4284e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:53Z,use_quota=True,user_id='f17217b516e544f1b273c06c7e86bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d77203f-6bf5-4f60-bb6d-175dedefdfe2),volume_type_id=4d77203f-6bf5-4f60-bb6d-175dedefdfe2)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2c978f-6a2c-4bf2-aca8-c2aca83998e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2c978f-6a2c-4bf2-aca8-c2aca83998e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73958073-a515-42ec-9444-0e8fbd0128d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73958073-a515-42ec-9444-0e8fbd0128d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee14bdb-94e6-4300-a68f-8d13120a37f5', 'volume_name': 'volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86bc830-473f-42c3-ba6a-b1d4760727c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86bc830-473f-42c3-ba6a-b1d4760727c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ab0996-d0eb-4796-9bba-85dcc7020ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Volume 1ee14bdb-94e6-4300-a68f-8d13120a37f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5', 'volume_size': 1} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2be3790e-cb7c-4444-b8e0-940dc6fc6193,created_at=2026-04-25T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-180272049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be3790e-cb7c-4444-b8e0-940dc6fc6193,host='devstack@QuobyteHD#QuobyteHD',id=1ee14bdb-94e6-4300-a68f-8d13120a37f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce29fd71c843e29eebe40ad4284e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:53Z,use_quota=True,user_id='f17217b516e544f1b273c06c7e86bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d77203f-6bf5-4f60-bb6d-175dedefdfe2),volume_type_id=4d77203f-6bf5-4f60-bb6d-175dedefdfe2)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Creating volume 1ee14bdb-94e6-4300-a68f-8d13120a37f5 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:52 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:53 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 1073741824 Apr 25 02:11:53 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (136caf2a-7967-488e-a714-5d4cd36ce5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b478d7-5957-4ddc-b822-326e68761220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b478d7-5957-4ddc-b822-326e68761220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1036940191',display_name='tempest-VolumesGetTest-Volume-175647039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e836df-da44-4e2c-a3c5-e969653525fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:53Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028f03f2-ef8f-46bc-9bfa-afa5f9eba355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028f03f2-ef8f-46bc-9bfa-afa5f9eba355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bab2a18-bf63-4129-ae64-64e79f308fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bab2a18-bf63-4129-ae64-64e79f308fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e836df-da44-4e2c-a3c5-e969653525fa', 'volume_name': 'volume-e1e836df-da44-4e2c-a3c5-e969653525fa', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374772c5-bdb9-417f-9a9e-57ef3cffe608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374772c5-bdb9-417f-9a9e-57ef3cffe608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a4a46f-a9ed-4fc4-babe-57e7037887ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:53 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Volume e1e836df-da44-4e2c-a3c5-e969653525fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e836df-da44-4e2c-a3c5-e969653525fa', 'volume_size': 1} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:53 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 1073741824" returned: 0 in 0.673s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:53 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 Apr 25 02:11:53 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:54 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5" returned: 0 in 0.485s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.003s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1036940191',display_name='tempest-VolumesGetTest-Volume-175647039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e836df-da44-4e2c-a3c5-e969653525fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6701179d7bc46329d570cfe673439bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:53Z,use_quota=True,user_id='21f734df51f3463f9560532c05955170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Creating volume e1e836df-da44-4e2c-a3c5-e969653525fa {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:54 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ab0996-d0eb-4796-9bba-85dcc7020ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:54 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa 1073741824 Apr 25 02:11:54 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a16b0fa-d61b-4ac6-95ed-f4e18d9716a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:54 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Volume volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 (1ee14bdb-94e6-4300-a68f-8d13120a37f5): created successfully Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a16b0fa-d61b-4ac6-95ed-f4e18d9716a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Flow 'volume_create_manager' (ed91e508-4020-4e1e-9ba3-d2d4deeecdcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:54 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-8122bc25-9d3a-402d-8f61-dd7209ad07e9 tempest-GroupSnapshotsTest-8609387 None] Created volume successfully. Apr 25 02:11:54 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa 1073741824" returned: 0 in 0.662s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:54 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa Apr 25 02:11:54 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:55 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa" returned: 0 in 0.621s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a4a46f-a9ed-4fc4-babe-57e7037887ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e836df-da44-4e2c-a3c5-e969653525fa', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017d795d-8da2-452c-b7b7-975c960e3426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:55 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Volume volume-e1e836df-da44-4e2c-a3c5-e969653525fa (e1e836df-da44-4e2c-a3c5-e969653525fa): created successfully Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017d795d-8da2-452c-b7b7-975c960e3426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Flow 'volume_create_manager' (136caf2a-7967-488e-a714-5d4cd36ce5a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Flow 'volume_create_manager' (e4a160ed-4a8f-47cf-a401-4a6c36f75274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471c7518-baaa-4844-91f7-e7099981d6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:55 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-2cdbbbdf-aee9-4ed6-89c1-61b4e7a05b38 tempest-VolumesGetTest-1060268551 None] Created volume successfully. Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471c7518-baaa-4844-91f7-e7099981d6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-427945156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be3790e-cb7c-4444-b8e0-940dc6fc6193,host='devstack@QuobyteHD#QuobyteHD',id=ef2e7a1a-75dd-4288-9930-fb9ae966ce5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce29fd71c843e29eebe40ad4284e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:56Z,use_quota=True,user_id='f17217b516e544f1b273c06c7e86bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d77203f-6bf5-4f60-bb6d-175dedefdfe2),volume_type_id=4d77203f-6bf5-4f60-bb6d-175dedefdfe2)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec17988f-d941-4559-8d01-21a657765f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec17988f-d941-4559-8d01-21a657765f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8724c13e-ffd6-493e-b212-94aaea1aa64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8724c13e-ffd6-493e-b212-94aaea1aa64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2e7a1a-75dd-4288-9930-fb9ae966ce5b', 'volume_name': 'volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251f673b-cae3-4fc0-88d8-c6d4a1c4311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251f673b-cae3-4fc0-88d8-c6d4a1c4311b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b0a572-bc2e-47b9-a7b4-c892c3ccfbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:55 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Volume ef2e7a1a-75dd-4288-9930-fb9ae966ce5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b', 'volume_size': 1} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2be3790e-cb7c-4444-b8e0-940dc6fc6193,created_at=2026-04-25T00:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-427945156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2be3790e-cb7c-4444-b8e0-940dc6fc6193,host='devstack@QuobyteHD#QuobyteHD',id=ef2e7a1a-75dd-4288-9930-fb9ae966ce5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce29fd71c843e29eebe40ad4284e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:11:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:11:56Z,use_quota=True,user_id='f17217b516e544f1b273c06c7e86bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d77203f-6bf5-4f60-bb6d-175dedefdfe2),volume_type_id=4d77203f-6bf5-4f60-bb6d-175dedefdfe2)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Creating volume ef2e7a1a-75dd-4288-9930-fb9ae966ce5b {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:11:55 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:11:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:55 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b 1073741824 Apr 25 02:11:55 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:56 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b 1073741824" returned: 0 in 0.780s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-e1e836df-da44-4e2c-a3c5-e969653525fa-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:56 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b Apr 25 02:11:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Lock "cinder-e1e836df-da44-4e2c-a3c5-e969653525fa-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:56 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-quobyte-e1e836df-da44-4e2c-a3c5-e969653525fa" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-e1e836df-da44-4e2c-a3c5-e969653525fa" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:56 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a3c854-4d15-438f-ba1d-306dc2e44c24]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:56 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa Apr 25 02:11:56 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:57 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" returned: 0 in 0.681s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b0a572-bc2e-47b9-a7b4-c892c3ccfbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f1ee4a-b576-48fd-bc41-44eac3bb4447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:11:57 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Volume volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b (ef2e7a1a-75dd-4288-9930-fb9ae966ce5b): created successfully Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f1ee4a-b576-48fd-bc41-44eac3bb4447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Flow 'volume_create_manager' (e4a160ed-4a8f-47cf-a401-4a6c36f75274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:11:57 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-fbb9793b-cc79-4b27-ab73-5b67d78c4925 tempest-GroupSnapshotsTest-8609387 None] Created volume successfully. Apr 25 02:11:57 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa" returned: 0 in 0.659s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:57 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa Apr 25 02:11:57 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:57 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1e836df-da44-4e2c-a3c5-e969653525fa" returned: 0 in 0.632s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-e1e836df-da44-4e2c-a3c5-e969653525fa" released by "delete_volume" :: held 1.354s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:58 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-74f5d520-f2b8-489c-a206-3c6dd9fe4d14 tempest-GroupSnapshotsTest-8609387 None] Update group completed successfully. Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Created reservations ['c653a21e-4343-45d5-af31-4a6dc42a7c75', 'e8dfc02b-ce6b-4de6-b6bf-fd3e2b9c667f', '044e1c93-5a6c-488e-a664-2899f6663d94', 'ea6a78b9-05ff-41c3-8d84-b06acb41a48a'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:58 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:11:58 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:58 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.456s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:11:58 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Deleted volume successfully. Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c3f4213-ebc6-44d0-be1c-07a69521fb06 tempest-VolumesGetTest-1060268551 None] Lock "cinder-e1e836df-da44-4e2c-a3c5-e969653525fa-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-196c611f-2a29-4b9f-a2c9-522909590916-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Lock "cinder-196c611f-2a29-4b9f-a2c9-522909590916-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Acquiring lock "cinder-quobyte-196c611f-2a29-4b9f-a2c9-522909590916" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-196c611f-2a29-4b9f-a2c9-522909590916" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1395b1-d1cc-44f2-b4bd-404fb88865d3]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:11:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:59 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 Apr 25 02:11:59 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:11:59 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1f64ff46-8115-4425-9870-b2c7a23251ab tempest-GroupSnapshotsTest-8609387 None] Update group completed successfully. Apr 25 02:11:59 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 25 02:11:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916" returned: 0 in 0.625s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:11:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:11:59 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 Apr 25 02:11:59 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Flow 'volume_create_manager' (c239b6e7-054b-4154-90c6-7f7fe8a83ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05638abe-fe44-45b8-9dab-31a622cad979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05638abe-fe44-45b8-9dab-31a622cad979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-660152290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad05125-5a05-4996-91eb-16bde54e43b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f143b84e49c4bb790daf1d9e4dd4518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:00Z,use_quota=True,user_id='f52764741fc042789b4bc1cff427ffa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d611663-18a3-4bb0-8878-b120f79b289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d611663-18a3-4bb0-8878-b120f79b289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d50a91-3ba1-41d5-b055-31c601396bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d50a91-3ba1-41d5-b055-31c601396bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad05125-5a05-4996-91eb-16bde54e43b8', 'volume_name': 'volume-dad05125-5a05-4996-91eb-16bde54e43b8', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0fae1f-e3c3-41b6-b9b5-90e2c1232033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd0fae1f-e3c3-41b6-b9b5-90e2c1232033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e5ca97-b1b2-4546-9b0c-c0fc43278da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:00 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Volume dad05125-5a05-4996-91eb-16bde54e43b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad05125-5a05-4996-91eb-16bde54e43b8', 'volume_size': 1} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-660152290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad05125-5a05-4996-91eb-16bde54e43b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f143b84e49c4bb790daf1d9e4dd4518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:00Z,use_quota=True,user_id='f52764741fc042789b4bc1cff427ffa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Creating volume dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:00 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:12:00 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916" returned: 1 in 0.654s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:00 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 1073741824 Apr 25 02:12:00 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:00 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916 Apr 25 02:12:00 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:00 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-2d338913-aca8-454e-ac33-b6aab4261fee tempest-GroupSnapshotsTest-8609387 None] Update group completed successfully. Apr 25 02:12:00 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-196c611f-2a29-4b9f-a2c9-522909590916" returned: 0 in 0.488s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Lock "cinder-quobyte-196c611f-2a29-4b9f-a2c9-522909590916" released by "delete_volume" :: held 1.838s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Created reservations ['6d097b31-e491-4798-bd36-2687a7eadde2', '4a28b618-0f22-4e39-9973-95e5e7a4ff0a', '5b0e6f33-731f-40db-97e6-decc34160d7e', 'b8746530-4dc4-4dc3-b70f-a67519b85e28'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:00 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 1073741824" returned: 0 in 0.620s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:00 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:12:00 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:00 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 Apr 25 02:12:00 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:01 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.443s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:12:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Deleted volume successfully. Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-af10ee12-4b91-4296-81ef-c4f84cd79d28 tempest-VolumesGetTest-1060268551 None] Lock "cinder-196c611f-2a29-4b9f-a2c9-522909590916-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:01 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c726d832-a2f3-4cba-9468-2a740486f0c4 tempest-GroupSnapshotsTest-8609387 None] Update group completed successfully. Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8" returned: 0 in 0.601s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e5ca97-b1b2-4546-9b0c-c0fc43278da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad05125-5a05-4996-91eb-16bde54e43b8', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28791049-fc49-41f9-8fa7-86c90c42cebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:01 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Volume volume-dad05125-5a05-4996-91eb-16bde54e43b8 (dad05125-5a05-4996-91eb-16bde54e43b8): created successfully Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28791049-fc49-41f9-8fa7-86c90c42cebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Flow 'volume_create_manager' (c239b6e7-054b-4154-90c6-7f7fe8a83ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-edc5d702-ea50-4655-957d-1141ce8cab57 tempest-VolumesActionsTest-779239255 None] Created volume successfully. Apr 25 02:12:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] GroupSnapshot 7f9a314e-53cb-4d57-931e-f29d645c35b0: creating. Apr 25 02:12:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Group snapshot 7f9a314e-53cb-4d57-931e-f29d645c35b0: creating. {{(pid=81927) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 25 02:12:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Creating offline snapshot 10418c80-3070-4546-b3e6-5203b9f8b529 of volume ef2e7a1a-75dd-4288-9930-fb9ae966ce5b {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:12:02 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3fac01-4ca5-453d-bec6-23a13d3e034a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:03 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b Apr 25 02:12:03 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:03 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" returned: 0 in 0.643s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:03 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 1G Apr 25 02:12:03 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:04 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 1G" returned: 0 in 0.802s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:04 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 Apr 25 02:12:04 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:05 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529" returned: 0 in 0.611s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:05 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:12:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:05 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 Apr 25 02:12:05 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:05 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529" returned: 0 in 0.519s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:05 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=155,cinder:SELECT=144,cinder:INSERT=50,cinder:DELETE=14 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:12:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:05 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.info Apr 25 02:12:05 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:06 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.info" returned: 0 in 0.505s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:06 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:06 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.info Apr 25 02:12:06 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Flow 'volume_create_manager' (943f6e3c-b497-4059-9bc4-cf6ad1629c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7a24a1-52ea-41c1-ba37-677e754b2ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7a24a1-52ea-41c1-ba37-677e754b2ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-771041906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c861332d-06a2-467b-a29a-c5356f5b2363,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31af6e957b0d49099487a2d00ffa7b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:06Z,use_quota=True,user_id='cdbc85903ec84ba6bc8ce2c6e2e37f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e5dd79-4250-4311-a914-1f374fbf7c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e5dd79-4250-4311-a914-1f374fbf7c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39cf9d4-7831-42e9-b7aa-31240968bd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39cf9d4-7831-42e9-b7aa-31240968bd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c861332d-06a2-467b-a29a-c5356f5b2363', 'volume_name': 'volume-c861332d-06a2-467b-a29a-c5356f5b2363', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2463b38-700b-4b3e-950b-c70149ae97d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2463b38-700b-4b3e-950b-c70149ae97d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf9898f-ddfd-4570-bc1c-ae39f0594bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:06 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Volume c861332d-06a2-467b-a29a-c5356f5b2363: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c861332d-06a2-467b-a29a-c5356f5b2363', 'volume_size': 1} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:06 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.info" returned: 0 in 0.493s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.665s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Creating offline snapshot 8d48614d-fa37-41f8-8487-e86433a000a1 of volume 1ee14bdb-94e6-4300-a68f-8d13120a37f5 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a1770f-ed70-458f-ae13-2f5095112e7d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:06 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 Apr 25 02:12:06 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:07 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5" returned: 0 in 0.528s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:07 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 1G Apr 25 02:12:07 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:07 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 1G" returned: 0 in 0.619s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:07 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 Apr 25 02:12:07 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:08 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1" returned: 0 in 0.482s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:08 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:12:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:08 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 Apr 25 02:12:08 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:08 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1" returned: 0 in 0.429s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:08 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.info Apr 25 02:12:08 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:09 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.info" returned: 0 in 0.433s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:09 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:09 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.info Apr 25 02:12:09 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:09 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.info" returned: 0 in 0.461s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.028s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.321s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-771041906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c861332d-06a2-467b-a29a-c5356f5b2363,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31af6e957b0d49099487a2d00ffa7b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:06Z,use_quota=True,user_id='cdbc85903ec84ba6bc8ce2c6e2e37f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Creating volume c861332d-06a2-467b-a29a-c5356f5b2363 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:12:09 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:12:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:09 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363 1073741824 Apr 25 02:12:09 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:09 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-6d64d0d3-9b99-429c-bbb6-e6ee99794959 tempest-GroupSnapshotsTest-8609387 None] group_snapshot 7f9a314e-53cb-4d57-931e-f29d645c35b0: created successfully Apr 25 02:12:10 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363 1073741824" returned: 0 in 0.629s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:10 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363 Apr 25 02:12:10 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:10 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] group_snapshot 7f9a314e-53cb-4d57-931e-f29d645c35b0: deleting Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] group_snapshot 7f9a314e-53cb-4d57-931e-f29d645c35b0: deleting {{(pid=81927) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-10418c80-3070-4546-b3e6-5203b9f8b529" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-10418c80-3070-4546-b3e6-5203b9f8b529" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Deleting offline snapshot 10418c80-3070-4546-b3e6-5203b9f8b529 of volume ef2e7a1a-75dd-4288-9930-fb9ae966ce5b {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] snapshot_file for this snap is: volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aeaf95-73b8-408e-80e3-a653cefade97]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:10 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 Apr 25 02:12:10 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:10 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363" returned: 0 in 0.569s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf9898f-ddfd-4570-bc1c-ae39f0594bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c861332d-06a2-467b-a29a-c5356f5b2363', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd01b7b8-4159-4283-b738-c418f5bfabfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:10 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Volume volume-c861332d-06a2-467b-a29a-c5356f5b2363 (c861332d-06a2-467b-a29a-c5356f5b2363): created successfully Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd01b7b8-4159-4283-b738-c418f5bfabfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Flow 'volume_create_manager' (943f6e3c-b497-4059-9bc4-cf6ad1629c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:10 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-22fec0c9-9185-4dd4-a2f1-5be0062e0146 tempest-VolumesListTestJSON-818184061 None] Created volume successfully. Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:11 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:12:11 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:11 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529" returned: 0 in 0.658s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3800379-8005-458f-bc27-de9bf095d567]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:11 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b Apr 25 02:12:11 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:11 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.481s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:12:11 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" returned: 0 in 0.777s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:12 devstack sudo[88001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 Apr 25 02:12:12 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Flow 'volume_create_manager' (9df17c03-fec0-43dc-8fb4-76e0de35ec7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa7eb73-ca73-4e00-a216-519ef34c4cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa7eb73-ca73-4e00-a216-519ef34c4cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-579164828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89376550-a0fb-44d6-acd2-f59d182c2dd7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31af6e957b0d49099487a2d00ffa7b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:12Z,use_quota=True,user_id='cdbc85903ec84ba6bc8ce2c6e2e37f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb65df2e-fbf2-4add-b085-0dc839355bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb65df2e-fbf2-4add-b085-0dc839355bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58174660-f800-44b6-b72f-56dd0740434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58174660-f800-44b6-b72f-56dd0740434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89376550-a0fb-44d6-acd2-f59d182c2dd7', 'volume_name': 'volume-89376550-a0fb-44d6-acd2-f59d182c2dd7', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8770a428-6708-48c4-87df-1449a12be3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8770a428-6708-48c4-87df-1449a12be3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351f031d-1836-47f3-9e8f-3ac7454a3233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:12 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Volume 89376550-a0fb-44d6-acd2-f59d182c2dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89376550-a0fb-44d6-acd2-f59d182c2dd7', 'volume_size': 1} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-579164828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89376550-a0fb-44d6-acd2-f59d182c2dd7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31af6e957b0d49099487a2d00ffa7b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:12Z,use_quota=True,user_id='cdbc85903ec84ba6bc8ce2c6e2e37f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Creating volume 89376550-a0fb-44d6-acd2-f59d182c2dd7 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:12:12 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:12 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 1073741824 Apr 25 02:12:12 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:12 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529" returned: 0 in 0.709s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:12 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529 Apr 25 02:12:12 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:12 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 1073741824" returned: 0 in 0.678s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:12 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 Apr 25 02:12:12 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:13 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b.10418c80-3070-4546-b3e6-5203b9f8b529" returned: 0 in 0.530s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-10418c80-3070-4546-b3e6-5203b9f8b529" released by "_delete_snapshot" :: held 2.770s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" released by "delete_snapshot" :: held 2.794s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-1ee14bdb-94e6-4300-a68f-8d13120a37f5" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-1ee14bdb-94e6-4300-a68f-8d13120a37f5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-8d48614d-fa37-41f8-8487-e86433a000a1" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-8d48614d-fa37-41f8-8487-e86433a000a1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Deleting offline snapshot 8d48614d-fa37-41f8-8487-e86433a000a1 of volume 1ee14bdb-94e6-4300-a68f-8d13120a37f5 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] snapshot_file for this snap is: volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[83347c4e-a2a0-43b7-9755-de5ec512f383]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:13 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 Apr 25 02:12:13 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:13 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7" returned: 0 in 0.519s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351f031d-1836-47f3-9e8f-3ac7454a3233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89376550-a0fb-44d6-acd2-f59d182c2dd7', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73dbe4a-7e1f-4c49-8f29-723a377a908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:13 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Volume volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 (89376550-a0fb-44d6-acd2-f59d182c2dd7): created successfully Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73dbe4a-7e1f-4c49-8f29-723a377a908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Flow 'volume_create_manager' (9df17c03-fec0-43dc-8fb4-76e0de35ec7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:13 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-20cdf674-7690-426f-b7f9-808de337b4e0 tempest-VolumesListTestJSON-818184061 None] Created volume successfully. Apr 25 02:12:13 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1" returned: 0 in 0.541s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe52b34-5b43-4b1a-a5c5-2d5e1148e901]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:13 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 Apr 25 02:12:13 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:14 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5" returned: 0 in 0.645s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:14 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 Apr 25 02:12:14 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Flow 'volume_create_manager' (d820e3fc-a689-45ab-893d-4abacaab0b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a24c9de-f54e-4429-8d18-badd7ad51269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a24c9de-f54e-4429-8d18-badd7ad51269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1474461339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31af6e957b0d49099487a2d00ffa7b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:15Z,use_quota=True,user_id='cdbc85903ec84ba6bc8ce2c6e2e37f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f9b3b9-741e-4326-8db1-b840f78554b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f9b3b9-741e-4326-8db1-b840f78554b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd6545d-6375-46ac-9e62-82526c3de164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd6545d-6375-46ac-9e62-82526c3de164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6', 'volume_name': 'volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e6168a-c132-4893-8c9a-681b4a556ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e6168a-c132-4893-8c9a-681b4a556ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21abc0f-4950-4b24-b19d-9210e2643f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:14 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Volume a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6', 'volume_size': 1} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1474461339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31af6e957b0d49099487a2d00ffa7b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:15Z,use_quota=True,user_id='cdbc85903ec84ba6bc8ce2c6e2e37f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Creating volume a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:12:14 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:12:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:14 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 1073741824 Apr 25 02:12:14 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:15 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1" returned: 0 in 0.601s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:15 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1 Apr 25 02:12:15 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:15 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 1073741824" returned: 0 in 0.612s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:15 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 Apr 25 02:12:15 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:15 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5.8d48614d-fa37-41f8-8487-e86433a000a1" returned: 0 in 0.516s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-8d48614d-fa37-41f8-8487-e86433a000a1" released by "_delete_snapshot" :: held 2.389s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-1ee14bdb-94e6-4300-a68f-8d13120a37f5" released by "delete_snapshot" :: held 2.410s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:15 devstack cinder-volume[81927]: WARNING cinder.quota [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-566992728 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-566992728, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:12:15 devstack cinder-volume[81927]: WARNING cinder.quota [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-566992728 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-566992728, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['37fc2123-25bb-4251-be3f-f4626d34eaa1', '080b7dee-5af6-46ca-a559-f914c6c9dd85', '2f99f7d5-a279-4e05-9b0b-e796a3f47f9a', 'f7f7cc78-e3e6-4bf2-b147-33d307a10184'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['b99fc616-83ba-456c-ac3f-1612f21dbd51', '403e7aa4-1d9c-49e9-8b74-8adf890212f5', 'c9bd7956-fc0d-4cf2-98ec-81d127b6f77c', '7ad092b9-6dae-4933-a044-e6815f0125f7'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:15 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6" returned: 0 in 0.556s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c21abc0f-4950-4b24-b19d-9210e2643f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e704f9-efea-44b0-866d-c995b90a5f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:15 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Volume volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 (a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6): created successfully Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e704f9-efea-44b0-866d-c995b90a5f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Flow 'volume_create_manager' (d820e3fc-a689-45ab-893d-4abacaab0b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:15 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dab20c69-f292-457e-9bfd-99c667418c31 tempest-VolumesListTestJSON-818184061 None] Created volume successfully. Apr 25 02:12:15 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4d16ef23-a4a3-4d50-a8ca-c8fc6f5bbe89 tempest-GroupSnapshotsTest-8609387 None] group_snapshot 7f9a314e-53cb-4d57-931e-f29d645c35b0: deleted successfully Apr 25 02:12:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-1ee14bdb-94e6-4300-a68f-8d13120a37f5" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-1ee14bdb-94e6-4300-a68f-8d13120a37f5" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:17 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3ec8d8-64d9-4a44-84ce-207a7341632e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:17 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 Apr 25 02:12:17 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:17 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5" returned: 0 in 0.581s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:17 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5 Apr 25 02:12:17 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:18 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1ee14bdb-94e6-4300-a68f-8d13120a37f5" returned: 0 in 0.568s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-1ee14bdb-94e6-4300-a68f-8d13120a37f5" released by "delete_volume" :: held 1.240s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:18 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e621bd19-ee85-4804-9ff6-08d0d49fa9e0]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:18 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b Apr 25 02:12:18 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "cinder-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "cinder-quobyte-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-quobyte-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6" acquired by "delete_volume" :: waited 0.029s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64b9438-760a-4b01-b124-a3a850d4ed32]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:19 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" returned: 0 in 0.886s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:19 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 Apr 25 02:12:19 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:19 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b Apr 25 02:12:19 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:19 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" returned: 0 in 0.525s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-ef2e7a1a-75dd-4288-9930-fb9ae966ce5b" released by "delete_volume" :: held 1.490s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:19 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6" returned: 0 in 0.686s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:19 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['434ab774-a6bb-454d-bb68-31442eb431c3'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:19 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6 Apr 25 02:12:19 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:19 devstack cinder-volume[81927]: WARNING cinder.quota [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-566992728 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-566992728, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['e219bfa8-e364-493d-a5d8-a4c1f810bc5e', 'f9acdadd-5544-473d-9792-d3936c649273', '35cc65da-0e5a-4d19-8690-344b0c1cd4cb', 'da485e57-650d-4f16-914d-28c0deb75a73'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['18a5d7dd-ac05-4495-9e7a-5ca16e94fe3d', '3b4bcdd2-d3ee-4039-91e0-c7bea7e0dc1c', 'a4959727-1ca0-4e24-94f4-41a6d9b88a7d', 'ea6e2a09-aa6a-490a-9035-c07757246c55'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:20 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:12:20 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:20 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6" returned: 0 in 0.648s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-quobyte-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6" released by "delete_volume" :: held 1.392s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Created reservations ['1e4bfd7d-8314-4295-b77e-c52a1a9a02ca', 'bc3b1da3-55c2-4e59-bb53-0aafacfcd559', 'a54937ac-9e3c-4a02-978d-6fd59e41b968', '968292aa-e015-4379-9d57-36a474497a16'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:20 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:12:20 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:21 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.826s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:12:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-74bfb011-7249-4bee-9e39-f706e513eab0 tempest-GroupSnapshotsTest-8609387 None] Delete group completed successfully. Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-16668719-4bd1-4d51-bc9d-0cbf40389e43 tempest-VolumesActionsTest-779239255 None] Acquiring lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8" by "attach_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-16668719-4bd1-4d51-bc9d-0cbf40389e43 tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8" acquired by "attach_volume" :: waited 0.029s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-16668719-4bd1-4d51-bc9d-0cbf40389e43 tempest-VolumesActionsTest-779239255 None] Attaching volume dad05125-5a05-4996-91eb-16bde54e43b8 to instance 4d983444-2ddd-4884-8bd9-cfbdbf7d61f3 at mountpoint /dev/vdb on host None. Apr 25 02:12:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-16668719-4bd1-4d51-bc9d-0cbf40389e43 tempest-VolumesActionsTest-779239255 None] Attach volume completed successfully. Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-16668719-4bd1-4d51-bc9d-0cbf40389e43 tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8" released by "attach_volume" :: held 0.132s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9d51d86e-2642-4a96-8fcf-303e4b601410 tempest-GroupSnapshotsTest-8609387 None] Group tempest-GroupSnapshotsTest-Group-1874501053: creating Apr 25 02:12:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9d51d86e-2642-4a96-8fcf-303e4b601410 tempest-GroupSnapshotsTest-8609387 None] Group tempest-GroupSnapshotsTest-Group-1874501053: created successfully Apr 25 02:12:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9d51d86e-2642-4a96-8fcf-303e4b601410 tempest-GroupSnapshotsTest-8609387 None] Create group completed successfully. Apr 25 02:12:21 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.726s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:12:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Deleted volume successfully. Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f0ba1a95-3773-47e4-b637-37a0bcbba658 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-a03bedb9-3eb3-4fb7-a378-bac57a2ffbc6-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "cinder-89376550-a0fb-44d6-acd2-f59d182c2dd7-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-89376550-a0fb-44d6-acd2-f59d182c2dd7-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "cinder-quobyte-89376550-a0fb-44d6-acd2-f59d182c2dd7" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-quobyte-89376550-a0fb-44d6-acd2-f59d182c2dd7" acquired by "delete_volume" :: waited 0.029s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f6987-b612-4da0-b130-af2dd92170cd]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9381f662-a3f0-4fa9-b116-039bcbd50784 tempest-VolumesActionsTest-779239255 None] Acquiring lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8-detach_volume" by "detach_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9381f662-a3f0-4fa9-b116-039bcbd50784 tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9381f662-a3f0-4fa9-b116-039bcbd50784 tempest-VolumesActionsTest-779239255 None] Detaching volume dad05125-5a05-4996-91eb-16bde54e43b8 from instance 4d983444-2ddd-4884-8bd9-cfbdbf7d61f3. Apr 25 02:12:21 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 Apr 25 02:12:21 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9381f662-a3f0-4fa9-b116-039bcbd50784 tempest-VolumesActionsTest-779239255 None] Detach volume completed successfully. Apr 25 02:12:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9381f662-a3f0-4fa9-b116-039bcbd50784 tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:22 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7" returned: 0 in 0.683s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:22 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7 Apr 25 02:12:22 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:22 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Flow 'volume_create_manager' (89c1c6df-f6e9-4db1-a279-627d5e54ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6db3b4-426a-400e-a30e-8cbf5ea1ae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6db3b4-426a-400e-a30e-8cbf5ea1ae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1488999365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dcf7054b-4615-46ee-b813-a14337dc01d2,host='devstack@QuobyteHD#QuobyteHD',id=65a74c24-a322-4a43-baf0-c872205e6ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce29fd71c843e29eebe40ad4284e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:23Z,use_quota=True,user_id='f17217b516e544f1b273c06c7e86bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e746383-a819-43fb-96b6-2ae62fc2e429),volume_type_id=9e746383-a819-43fb-96b6-2ae62fc2e429)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23919675-d1a3-4737-8ef4-79e1fc0be76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23919675-d1a3-4737-8ef4-79e1fc0be76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73b6a04-3c22-41d8-830e-41445586bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73b6a04-3c22-41d8-830e-41445586bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65a74c24-a322-4a43-baf0-c872205e6ea1', 'volume_name': 'volume-65a74c24-a322-4a43-baf0-c872205e6ea1', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1dce17-b5ed-4155-b025-6866273ee3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1dce17-b5ed-4155-b025-6866273ee3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d13474-67a2-4b99-933d-5564b3e78731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:23 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Volume 65a74c24-a322-4a43-baf0-c872205e6ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65a74c24-a322-4a43-baf0-c872205e6ea1', 'volume_size': 1} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dcf7054b-4615-46ee-b813-a14337dc01d2,created_at=2026-04-25T00:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1488999365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dcf7054b-4615-46ee-b813-a14337dc01d2,host='devstack@QuobyteHD#QuobyteHD',id=65a74c24-a322-4a43-baf0-c872205e6ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fce29fd71c843e29eebe40ad4284e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:23Z,use_quota=True,user_id='f17217b516e544f1b273c06c7e86bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e746383-a819-43fb-96b6-2ae62fc2e429),volume_type_id=9e746383-a819-43fb-96b6-2ae62fc2e429)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Creating volume 65a74c24-a322-4a43-baf0-c872205e6ea1 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:12:23 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:23 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 1073741824 Apr 25 02:12:23 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:23 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-89376550-a0fb-44d6-acd2-f59d182c2dd7" returned: 0 in 0.708s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-quobyte-89376550-a0fb-44d6-acd2-f59d182c2dd7" released by "delete_volume" :: held 1.444s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Created reservations ['6a082891-74a1-4025-b2b5-fb748beb7af4', '2e995675-6f38-43df-a7c0-a382cc1763fd', 'f47aa210-f550-4985-a8bf-b0dd28690137', '242e71ca-0f47-4093-88e1-5510ccec1214'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:23 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:12:23 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:23 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 1073741824" returned: 0 in 0.685s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:23 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 Apr 25 02:12:23 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:23 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.576s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:12:23 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Deleted volume successfully. Apr 25 02:12:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-41bc3bb2-e1cb-4382-a8f7-f84f0abc8f58 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-89376550-a0fb-44d6-acd2-f59d182c2dd7-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "cinder-c861332d-06a2-467b-a29a-c5356f5b2363-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-c861332d-06a2-467b-a29a-c5356f5b2363-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "cinder-quobyte-c861332d-06a2-467b-a29a-c5356f5b2363" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-quobyte-c861332d-06a2-467b-a29a-c5356f5b2363" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6875053e-7a25-4651-8c61-5998dc5f1e86]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:24 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363 Apr 25 02:12:24 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:24 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1" returned: 0 in 0.717s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d13474-67a2-4b99-933d-5564b3e78731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65a74c24-a322-4a43-baf0-c872205e6ea1', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99015f97-bdcc-4868-b128-5d7e039abe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:24 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Volume volume-65a74c24-a322-4a43-baf0-c872205e6ea1 (65a74c24-a322-4a43-baf0-c872205e6ea1): created successfully Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99015f97-bdcc-4868-b128-5d7e039abe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Flow 'volume_create_manager' (89c1c6df-f6e9-4db1-a279-627d5e54ed60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:24 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-366a8b14-9e5e-445f-9dab-fac7c2855704 tempest-GroupSnapshotsTest-8609387 None] Created volume successfully. Apr 25 02:12:24 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363" returned: 0 in 0.594s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:24 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363 Apr 25 02:12:24 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:25 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c861332d-06a2-467b-a29a-c5356f5b2363" returned: 0 in 0.496s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-quobyte-c861332d-06a2-467b-a29a-c5356f5b2363" released by "delete_volume" :: held 1.133s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:25 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] GroupSnapshot bcc59193-e0a4-4562-bf0c-b35c02a88a17: creating. Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Group snapshot bcc59193-e0a4-4562-bf0c-b35c02a88a17: creating. {{(pid=81927) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Creating offline snapshot 95368b61-f1ec-411e-8540-6b1cab1815f8 of volume 65a74c24-a322-4a43-baf0-c872205e6ea1 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc51692-aed4-4949-8b1d-7556e611f602]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Created reservations ['256b4f8d-48d0-4373-a807-64a2c477aa71', '480bdd76-2b79-4401-8f22-6c50421031d8', 'bdd27114-3a42-492c-8b94-563eace632f8', '4e5660e2-217f-4b7e-8ab3-207ce1d836b9'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:25 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 Apr 25 02:12:25 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:25 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:12:25 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:26 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.468s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:26 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:12:26 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Deleted volume successfully. Apr 25 02:12:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dbaaaa4d-9b27-4343-9db5-d1a203d062e2 tempest-VolumesListTestJSON-818184061 None] Lock "cinder-c861332d-06a2-467b-a29a-c5356f5b2363-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:26 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1" returned: 0 in 0.598s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:26 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 1G Apr 25 02:12:26 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:26 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 1G" returned: 0 in 0.671s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a74c24-a322-4a43-baf0-c872205e6ea1 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:26 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a74c24-a322-4a43-baf0-c872205e6ea1 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 Apr 25 02:12:26 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:27 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65a74c24-a322-4a43-baf0-c872205e6ea1 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8" returned: 0 in 0.563s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:27 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:12:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:27 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 Apr 25 02:12:27 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:27 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8" returned: 0 in 0.562s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:27 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.info Apr 25 02:12:27 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:28 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.info" returned: 0 in 0.442s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:28 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 02:12:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:28 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.info Apr 25 02:12:28 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:28 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.info" returned: 0 in 0.489s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.412s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c87aeced-e70d-4d08-abab-056f2a77ddb0 tempest-GroupSnapshotsTest-8609387 None] group_snapshot bcc59193-e0a4-4562-bf0c-b35c02a88a17: created successfully Apr 25 02:12:29 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] group_snapshot bcc59193-e0a4-4562-bf0c-b35c02a88a17: deleting Apr 25 02:12:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] group_snapshot bcc59193-e0a4-4562-bf0c-b35c02a88a17: deleting {{(pid=81927) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 25 02:12:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-65a74c24-a322-4a43-baf0-c872205e6ea1" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-65a74c24-a322-4a43-baf0-c872205e6ea1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-95368b61-f1ec-411e-8540-6b1cab1815f8" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-95368b61-f1ec-411e-8540-6b1cab1815f8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Deleting offline snapshot 95368b61-f1ec-411e-8540-6b1cab1815f8 of volume 65a74c24-a322-4a43-baf0-c872205e6ea1 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:12:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] snapshot_file for this snap is: volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:12:29 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc51a5fc-95ea-4794-b2a2-62291d6748a0]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:30 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 Apr 25 02:12:30 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:30 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8" returned: 0 in 0.647s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65a74c24-a322-4a43-baf0-c872205e6ea1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:12:30 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f214e5d6-1478-4414-84fa-2ad496349341]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:30 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 Apr 25 02:12:30 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:31 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1" returned: 0 in 0.719s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:31 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 Apr 25 02:12:31 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:32 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8" returned: 0 in 0.681s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:32 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8 Apr 25 02:12:32 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:32 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1.95368b61-f1ec-411e-8540-6b1cab1815f8" returned: 0 in 0.498s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-95368b61-f1ec-411e-8540-6b1cab1815f8" released by "_delete_snapshot" :: held 2.653s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-65a74c24-a322-4a43-baf0-c872205e6ea1" released by "delete_snapshot" :: held 2.676s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:32 devstack cinder-volume[81927]: WARNING cinder.quota [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1385485876 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1385485876, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:12:32 devstack cinder-volume[81927]: WARNING cinder.quota [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1385485876 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1385485876, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:12:32 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] Created reservations ['ac81a60a-9dce-4397-8f2e-54a6e02b151d', '11a9ac6f-9fb4-4596-8e31-5c72e3211b2f', '1d5c1e5a-7e61-4394-9afd-f6a827ada2f2', 'f4dcdabe-9caf-412b-8bcf-d5df662636b4'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:32 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-fd58b797-3e16-4a13-9c8d-1a2e48e620bf tempest-GroupSnapshotsTest-8609387 None] group_snapshot bcc59193-e0a4-4562-bf0c-b35c02a88a17: deleted successfully Apr 25 02:12:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "cinder-quobyte-65a74c24-a322-4a43-baf0-c872205e6ea1" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-65a74c24-a322-4a43-baf0-c872205e6ea1" acquired by "delete_volume" :: waited 0.027s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:33 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec096d7c-d3d5-4ce5-a9bf-51dc46d282cc]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:33 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 Apr 25 02:12:33 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:34 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1" returned: 0 in 0.645s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:34 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1 Apr 25 02:12:34 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:34 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65a74c24-a322-4a43-baf0-c872205e6ea1" returned: 0 in 0.548s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Lock "cinder-quobyte-65a74c24-a322-4a43-baf0-c872205e6ea1" released by "delete_volume" :: held 1.291s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['207eae65-7709-4b41-b153-b58fdfe53f99'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:34 devstack cinder-volume[81927]: WARNING cinder.quota [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1385485876 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1385485876, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Created reservations ['7db952c7-98bf-4ecd-8c4d-015640b0ff5f', 'dc476c76-2081-4e2d-b430-89ef39716e72', '7bea9475-70ec-460b-9bdf-e3c4d4580d50', '2925a1d1-5fe1-4035-b2e3-caf1f8faccee'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:34 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:12:34 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:35 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.548s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:35 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:12:35 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5922baa2-652e-45b6-8667-c6bcf434e336 tempest-GroupSnapshotsTest-8609387 None] Delete group completed successfully. Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (f352e0b4-40c2-44d8-be86-9c97d4a6e738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a3967a-a55e-4877-b278-ad3470842338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a3967a-a55e-4877-b278-ad3470842338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1696224874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baa874e-f4c8-463a-ae5f-361d7120e35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f01066624c244a39d9675a5d9514d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:38Z,use_quota=True,user_id='36e819e8a9f84215b5235c604fa721e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9ee1d3-91e0-40f4-96ae-f08804e66aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b9ee1d3-91e0-40f4-96ae-f08804e66aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f87de58-494d-4975-bc26-4c1e88cbdce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f87de58-494d-4975-bc26-4c1e88cbdce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8baa874e-f4c8-463a-ae5f-361d7120e35c', 'volume_name': 'volume-8baa874e-f4c8-463a-ae5f-361d7120e35c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c6b41b-25e2-4225-bb3a-00f398da6ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c6b41b-25e2-4225-bb3a-00f398da6ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79abda03-1d88-4e6d-9a85-33b0180b24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:38 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Volume 8baa874e-f4c8-463a-ae5f-361d7120e35c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8baa874e-f4c8-463a-ae5f-361d7120e35c', 'volume_size': 1} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1696224874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8baa874e-f4c8-463a-ae5f-361d7120e35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f01066624c244a39d9675a5d9514d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:38Z,use_quota=True,user_id='36e819e8a9f84215b5235c604fa721e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Creating volume 8baa874e-f4c8-463a-ae5f-361d7120e35c {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:12:38 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:12:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:38 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c 1073741824 Apr 25 02:12:38 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:39 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c 1073741824" returned: 0 in 0.782s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:39 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c Apr 25 02:12:39 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:39 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c" returned: 0 in 0.487s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:12:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79abda03-1d88-4e6d-9a85-33b0180b24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8baa874e-f4c8-463a-ae5f-361d7120e35c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0d8270-e640-419e-9d87-2da951d48492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:39 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Volume volume-8baa874e-f4c8-463a-ae5f-361d7120e35c (8baa874e-f4c8-463a-ae5f-361d7120e35c): created successfully Apr 25 02:12:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0d8270-e640-419e-9d87-2da951d48492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (f352e0b4-40c2-44d8-be86-9c97d4a6e738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:39 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-2889c5d1-271b-4eee-a5bd-e3101aac614f tempest-VolumesSnapshotTestJSON-1068079177 None] Created volume successfully. Apr 25 02:12:40 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=170,cinder:INSERT=58,cinder:UPDATE=178,cinder:DELETE=9 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:12:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Creating offline snapshot f47d815c-81da-47aa-8e52-82067120a020 of volume 8baa874e-f4c8-463a-ae5f-361d7120e35c {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:12:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[481fab6e-8535-4acb-8379-c68c52d411d1]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:41 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c Apr 25 02:12:41 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:41 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c" returned: 0 in 0.614s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:41 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 1G Apr 25 02:12:41 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:42 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 1G" returned: 0 in 0.682s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa874e-f4c8-463a-ae5f-361d7120e35c -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:42 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa874e-f4c8-463a-ae5f-361d7120e35c -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 Apr 25 02:12:42 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:42 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8baa874e-f4c8-463a-ae5f-361d7120e35c -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020" returned: 0 in 0.568s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:42 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 is being set with open permissions: ugo+rw Apr 25 02:12:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:42 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 Apr 25 02:12:42 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:43 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020" returned: 0 in 0.481s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:43 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.info Apr 25 02:12:43 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:44 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.info" returned: 0 in 0.864s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:44 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.info is being set with open permissions: ugo+rw Apr 25 02:12:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:44 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.info Apr 25 02:12:44 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:44 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.info" returned: 0 in 0.619s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.946s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:44 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e00a87ac-83f7-44ee-87d1-f6a9c18e4a11 tempest-VolumesSnapshotTestJSON-1068079177 None] Create snapshot completed successfully Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-f47d815c-81da-47aa-8e52-82067120a020-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-f47d815c-81da-47aa-8e52-82067120a020-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-8baa874e-f4c8-463a-ae5f-361d7120e35c" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-8baa874e-f4c8-463a-ae5f-361d7120e35c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-f47d815c-81da-47aa-8e52-82067120a020" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-f47d815c-81da-47aa-8e52-82067120a020" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Deleting offline snapshot f47d815c-81da-47aa-8e52-82067120a020 of volume 8baa874e-f4c8-463a-ae5f-361d7120e35c {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] snapshot_file for this snap is: volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6763a27-37f5-43b4-8a2a-7ca908aedd82]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:45 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 Apr 25 02:12:45 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:46 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020" returned: 0 in 0.704s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:46 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8baa874e-f4c8-463a-ae5f-361d7120e35c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:12:46 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dd56d1-0eec-46d3-8012-47ebd06203ff]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:46 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c Apr 25 02:12:46 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:47 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4a17ce7f-6474-4318-b702-42927a4feeb2 tempest-GroupsTest-1597014103 None] Group tempest-Group1-1227808413: creating Apr 25 02:12:47 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4a17ce7f-6474-4318-b702-42927a4feeb2 tempest-GroupsTest-1597014103 None] Group tempest-Group1-1227808413: created successfully Apr 25 02:12:47 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4a17ce7f-6474-4318-b702-42927a4feeb2 tempest-GroupsTest-1597014103 None] Create group completed successfully. Apr 25 02:12:47 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c" returned: 0 in 0.809s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:47 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 Apr 25 02:12:47 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:47 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020" returned: 0 in 0.569s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:47 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020 Apr 25 02:12:47 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-394b5943-0274-4a4e-9c8f-d45f9c72b307 tempest-VolumesActionsTest-779239255 None] Acquiring lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8" by "attach_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:48 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c.f47d815c-81da-47aa-8e52-82067120a020" returned: 0 in 0.512s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-394b5943-0274-4a4e-9c8f-d45f9c72b307 tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8" acquired by "attach_volume" :: waited 0.034s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-f47d815c-81da-47aa-8e52-82067120a020" released by "_delete_snapshot" :: held 2.800s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-955f394a-9ef3-45bf-8b46-83baa5803617 tempest-GroupsTest-1597014103 None] Group tempest-Group2-390095738: creating Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-8baa874e-f4c8-463a-ae5f-361d7120e35c" released by "delete_snapshot" :: held 2.858s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-955f394a-9ef3-45bf-8b46-83baa5803617 tempest-GroupsTest-1597014103 None] Group tempest-Group2-390095738: created successfully Apr 25 02:12:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-394b5943-0274-4a4e-9c8f-d45f9c72b307 tempest-VolumesActionsTest-779239255 None] Attaching volume dad05125-5a05-4996-91eb-16bde54e43b8 to instance 0b91704d-a1e3-4733-a532-b027f31b839d at mountpoint /dev/vdb on host None. Apr 25 02:12:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-955f394a-9ef3-45bf-8b46-83baa5803617 tempest-GroupsTest-1597014103 None] Create group completed successfully. Apr 25 02:12:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-394b5943-0274-4a4e-9c8f-d45f9c72b307 tempest-VolumesActionsTest-779239255 None] Attach volume completed successfully. Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-394b5943-0274-4a4e-9c8f-d45f9c72b307 tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8" released by "attach_volume" :: held 0.198s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Created reservations ['ad05f408-c245-42ea-996f-0df3b204ffa1', '21e3773a-e411-470d-9daa-df1433f56382', 'd7f94139-9cba-4a67-b327-2458317966dd', 'e8bf954d-a351-449d-bf17-daf6cde98b81'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Delete snapshot completed successfully. Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fab3d152-7863-4de3-ac91-8e752d796a01 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-f47d815c-81da-47aa-8e52-82067120a020-delete_snapshot" released by "delete_snapshot" :: held 3.100s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1439b347-f798-40d5-a768-0ee3450815f1 tempest-VolumesActionsTest-779239255 None] Acquiring lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8-detach_volume" by "detach_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1439b347-f798-40d5-a768-0ee3450815f1 tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1439b347-f798-40d5-a768-0ee3450815f1 tempest-VolumesActionsTest-779239255 None] Detaching volume dad05125-5a05-4996-91eb-16bde54e43b8 from instance 0b91704d-a1e3-4733-a532-b027f31b839d. Apr 25 02:12:48 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1439b347-f798-40d5-a768-0ee3450815f1 tempest-VolumesActionsTest-779239255 None] Detach volume completed successfully. Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1439b347-f798-40d5-a768-0ee3450815f1 tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (dc7f8786-98a5-4426-bc1d-204decc8a62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea49e5c4-820d-4485-8a85-05b0117cf5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea49e5c4-820d-4485-8a85-05b0117cf5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1624350866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f18c83-2622-485f-9768-f97e9c996239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f01066624c244a39d9675a5d9514d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:49Z,use_quota=True,user_id='36e819e8a9f84215b5235c604fa721e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3c5bf1-ba22-4e74-974a-bd7cebb2cb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3c5bf1-ba22-4e74-974a-bd7cebb2cb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ba5f9f-5ebc-42f3-ba4c-1c3bde34e70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52ba5f9f-5ebc-42f3-ba4c-1c3bde34e70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f18c83-2622-485f-9768-f97e9c996239', 'volume_name': 'volume-42f18c83-2622-485f-9768-f97e9c996239', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d7e9eb-c57e-452c-af76-adbd5f2bdbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d7e9eb-c57e-452c-af76-adbd5f2bdbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1f36f8-0d68-4cc8-9814-518e4941159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:49 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Volume 42f18c83-2622-485f-9768-f97e9c996239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f18c83-2622-485f-9768-f97e9c996239', 'volume_size': 1} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1624350866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f18c83-2622-485f-9768-f97e9c996239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f01066624c244a39d9675a5d9514d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:49Z,use_quota=True,user_id='36e819e8a9f84215b5235c604fa721e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Creating volume 42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:12:49 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:49 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 1073741824 Apr 25 02:12:49 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:49 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Flow 'volume_create_manager' (90981598-d9ab-452a-a3fd-0cccb17c15b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a156bcf-1c5d-4084-8dca-dededea15bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 1073741824" returned: 0 in 0.819s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a156bcf-1c5d-4084-8dca-dededea15bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946145629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99f4edc0-5881-4a81-8af7-432c57c45862,host='devstack@QuobyteHD#QuobyteHD',id=decad9ce-773b-4e52-abff-618691e39f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba74895739a43aba2d0cc9a7e7b10cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:50Z,use_quota=True,user_id='b685c708f49c4085942cb90243e58a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8d0b1e-5045-4ce5-b94c-aad3fe53c86e),volume_type_id=0c8d0b1e-5045-4ce5-b94c-aad3fe53c86e)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2655db16-9d4a-4df8-ac97-93e99fa7d3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2655db16-9d4a-4df8-ac97-93e99fa7d3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89eb779-f0cd-4614-8439-97a84ec1743c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89eb779-f0cd-4614-8439-97a84ec1743c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'decad9ce-773b-4e52-abff-618691e39f50', 'volume_name': 'volume-decad9ce-773b-4e52-abff-618691e39f50', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ede8e9-6ffa-43ea-9132-d943c9c19cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ede8e9-6ffa-43ea-9132-d943c9c19cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9aaace2-2209-4bc5-8838-4e7eff585e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:50 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Volume decad9ce-773b-4e52-abff-618691e39f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-decad9ce-773b-4e52-abff-618691e39f50', 'volume_size': 1} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:50 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 Apr 25 02:12:50 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:50 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239" returned: 0 in 0.479s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.521s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=99f4edc0-5881-4a81-8af7-432c57c45862,created_at=2026-04-25T00:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946145629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=99f4edc0-5881-4a81-8af7-432c57c45862,host='devstack@QuobyteHD#QuobyteHD',id=decad9ce-773b-4e52-abff-618691e39f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba74895739a43aba2d0cc9a7e7b10cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:50Z,use_quota=True,user_id='b685c708f49c4085942cb90243e58a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c8d0b1e-5045-4ce5-b94c-aad3fe53c86e),volume_type_id=0c8d0b1e-5045-4ce5-b94c-aad3fe53c86e)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Creating volume decad9ce-773b-4e52-abff-618691e39f50 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:12:50 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1f36f8-0d68-4cc8-9814-518e4941159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f18c83-2622-485f-9768-f97e9c996239', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7305c3ae-5fd1-49f7-b15f-a53823ff1fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:50 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50 1073741824 Apr 25 02:12:50 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:50 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Volume volume-42f18c83-2622-485f-9768-f97e9c996239 (42f18c83-2622-485f-9768-f97e9c996239): created successfully Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7305c3ae-5fd1-49f7-b15f-a53823ff1fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (dc7f8786-98a5-4426-bc1d-204decc8a62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:50 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5c714887-f982-455a-857d-baa437076daa tempest-VolumesSnapshotTestJSON-1068079177 None] Created volume successfully. Apr 25 02:12:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:51 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50 1073741824" returned: 0 in 0.982s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:51 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50 Apr 25 02:12:51 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:52 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50" returned: 0 in 0.453s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.507s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9aaace2-2209-4bc5-8838-4e7eff585e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-decad9ce-773b-4e52-abff-618691e39f50', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9818c502-a827-49b5-898b-30277f5b7eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Creating offline snapshot 4d41cb8c-c49d-4aba-bb10-83808cb27cd4 of volume 42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:12:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Volume volume-decad9ce-773b-4e52-abff-618691e39f50 (decad9ce-773b-4e52-abff-618691e39f50): created successfully Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9818c502-a827-49b5-898b-30277f5b7eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Flow 'volume_create_manager' (90981598-d9ab-452a-a3fd-0cccb17c15b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[96103829-d502-4874-961f-0611359eaec8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:52 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bebecf67-e125-4cb7-8bde-580c4012ea15 tempest-GroupsTest-1597014103 None] Created volume successfully. Apr 25 02:12:52 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 Apr 25 02:12:52 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:52 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239" returned: 0 in 0.566s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:52 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 1G Apr 25 02:12:52 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:53 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 1G" returned: 0 in 0.680s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42f18c83-2622-485f-9768-f97e9c996239 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:53 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42f18c83-2622-485f-9768-f97e9c996239 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 Apr 25 02:12:53 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Acquiring lock "cinder-quobyte-decad9ce-773b-4e52-abff-618691e39f50" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Lock "cinder-quobyte-decad9ce-773b-4e52-abff-618691e39f50" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:53 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d42db74-d834-484d-852f-00e1cf42033c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:53 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50 Apr 25 02:12:53 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:53 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42f18c83-2622-485f-9768-f97e9c996239 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4" returned: 0 in 0.570s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:53 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 is being set with open permissions: ugo+rw Apr 25 02:12:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:53 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 Apr 25 02:12:53 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:54 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50" returned: 0 in 0.520s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:54 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50 Apr 25 02:12:54 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:54 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4" returned: 0 in 0.456s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:54 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.info Apr 25 02:12:54 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:54 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-decad9ce-773b-4e52-abff-618691e39f50" returned: 0 in 0.481s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Lock "cinder-quobyte-decad9ce-773b-4e52-abff-618691e39f50" released by "delete_volume" :: held 1.066s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Created reservations ['aea51bac-b77e-4af3-82df-83992d00cfd3'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:54 devstack cinder-volume[81927]: WARNING cinder.quota [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1240753109 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1240753109, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:12:54 devstack cinder-volume[81927]: WARNING cinder.quota [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1240753109 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1240753109, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Created reservations ['20b612d1-0de0-435f-ba28-043e2c71963f', 'ff5139be-fa84-424e-b21e-23fe9b5f55ea', '8158adf5-9645-4bdc-906a-ce98ffcdca7b', 'fc03a048-c8c6-4d01-8e6e-bfc040bb20c3'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:54 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.info" returned: 0 in 0.494s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:54 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.info is being set with open permissions: ugo+rw Apr 25 02:12:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:54 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.info Apr 25 02:12:54 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:55 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:12:55 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:55 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.info" returned: 0 in 0.436s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.349s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:55 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-683ff67d-44f6-4899-a43f-63f0ecdc5aaf tempest-VolumesSnapshotTestJSON-1068079177 None] Create snapshot completed successfully Apr 25 02:12:55 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.462s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:55 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:12:55 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f5a53ed0-b803-4786-9f35-72154ba6fbd6 tempest-GroupsTest-1597014103 None] Delete group completed successfully. Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (9be22cd3-f0e6-43be-aeb7-e6f998bdaed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2064d95d-0ad7-4537-9bb2-3427290f3700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2064d95d-0ad7-4537-9bb2-3427290f3700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1857931704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cfafba-2fd8-412d-88a9-b8165eb0f3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f01066624c244a39d9675a5d9514d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:12:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4d41cb8c-c49d-4aba-bb10-83808cb27cd4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:12:56Z,use_quota=True,user_id='36e819e8a9f84215b5235c604fa721e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05a4f07-2a86-45b6-a267-7abec3dabe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05a4f07-2a86-45b6-a267-7abec3dabe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e41b039-81f3-43d7-a61a-9754aec10c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e41b039-81f3-43d7-a61a-9754aec10c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62cfafba-2fd8-412d-88a9-b8165eb0f3ce', 'volume_name': 'volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce', 'volume_size': 2, 'snapshot_id': '4d41cb8c-c49d-4aba-bb10-83808cb27cd4'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07adace-9eee-4b34-9407-a1b5efcfcb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07adace-9eee-4b34-9407-a1b5efcfcb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1684ec-de31-450c-bae3-38cbc03a15d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:56 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Volume 62cfafba-2fd8-412d-88a9-b8165eb0f3ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce', 'volume_size': 2, 'snapshot_id': '4d41cb8c-c49d-4aba-bb10-83808cb27cd4'} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-4d41cb8c-c49d-4aba-bb10-83808cb27cd4-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" by "_create_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-4d41cb8c-c49d-4aba-bb10-83808cb27cd4-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Creating volume 62cfafba-2fd8-412d-88a9-b8165eb0f3ce from snapshot 4d41cb8c-c49d-4aba-bb10-83808cb27cd4 {{(pid=81927) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] snapshot: 4d41cb8c-c49d-4aba-bb10-83808cb27cd4, volume: 62cfafba-2fd8-412d-88a9-b8165eb0f3ce, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a5e446-7cc2-4fdc-aecf-0e0136f725c2]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] Created reservations ['2745dcfb-5d61-42d2-be59-693226a9b24d'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:56 devstack sudo[88502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 Apr 25 02:12:56 devstack sudo[88502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:56 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:12:56 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:56 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.445s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:12:56 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ca9238fb-6dd9-4e98-888a-9ca5a1271776 tempest-GroupsTest-1597014103 None] Delete group completed successfully. Apr 25 02:12:56 devstack sudo[88502]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4" returned: 0 in 0.594s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42f18c83-2622-485f-9768-f97e9c996239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb3146-9cbd-4f2c-aae5-40d6d0822f12]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:12:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:56 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 Apr 25 02:12:56 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:57 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Apr 25 02:12:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239" returned: 0 in 0.639s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:12:57 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:12:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:12:57 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce Apr 25 02:12:57 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:12:57 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e7e3fa46-fccc-4056-be17-cebd1c321fad tempest-GroupsTest-1597014103 None] Group tempest-GroupsTest-Group-435582221: creating Apr 25 02:12:57 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e7e3fa46-fccc-4056-be17-cebd1c321fad tempest-GroupsTest-1597014103 None] Group tempest-GroupsTest-Group-435582221: created successfully Apr 25 02:12:57 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e7e3fa46-fccc-4056-be17-cebd1c321fad tempest-GroupsTest-1597014103 None] Create group completed successfully. Apr 25 02:12:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:12:59 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:12:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Flow 'volume_create_manager' (b4a23471-c682-457d-866d-af4b27d82b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:12:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf31a45-4aad-4cb7-b3da-b69b4f9ea6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:12:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf31a45-4aad-4cb7-b3da-b69b4f9ea6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-371628404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f825b4c-b3c3-49ea-b520-5a1ee3d52a3d,host='devstack@QuobyteHD#QuobyteHD',id=8139c86a-9e11-4552-91c2-2446a3d0ffd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba74895739a43aba2d0cc9a7e7b10cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:00Z,use_quota=True,user_id='b685c708f49c4085942cb90243e58a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ebe7a52-ecbf-470a-93ee-614a9c3ab001),volume_type_id=0ebe7a52-ecbf-470a-93ee-614a9c3ab001)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a02870b-29e2-4f07-99d8-3629b1a04172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a02870b-29e2-4f07-99d8-3629b1a04172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5af3aa4-59b7-46e3-8601-03e783b854aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5af3aa4-59b7-46e3-8601-03e783b854aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8139c86a-9e11-4552-91c2-2446a3d0ffd2', 'volume_name': 'volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d69cb85-dbaa-420e-8f37-7dd344bda534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d69cb85-dbaa-420e-8f37-7dd344bda534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06660840-7d16-4ffb-86ef-240261c61ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:00 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Volume 8139c86a-9e11-4552-91c2-2446a3d0ffd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2', 'volume_size': 1} Apr 25 02:13:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:02 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" returned: 0 in 5.044s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:02 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[85779bea-ffab-4ad4-81f4-67b9ce085ca9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:02 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 Apr 25 02:13:02 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:03 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239" returned: 0 in 0.636s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239, size 1024.00 MB, duration 5.04 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:13:03 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Converted 1024.00 MB image at 202.97 MB/s Apr 25 02:13:03 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce is being set with open permissions: ugo+rw Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:03 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce Apr 25 02:13:03 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:03 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" returned: 0 in 0.435s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" released by "_copy_volume_from_snapshot" :: held 7.442s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-4d41cb8c-c49d-4aba-bb10-83808cb27cd4-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" released by "_create_volume_from_snapshot" :: held 7.477s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.515s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.938s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f4327-1c70-4561-bbcb-bc8049a47971]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1684ec-de31-450c-bae3-38cbc03a15d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce', 'volume_size': 2, 'snapshot_id': '4d41cb8c-c49d-4aba-bb10-83808cb27cd4'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fa46c2-b0aa-43df-980f-ad52ed01b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:03 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Volume volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce (62cfafba-2fd8-412d-88a9-b8165eb0f3ce): created successfully Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fa46c2-b0aa-43df-980f-ad52ed01b72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (9be22cd3-f0e6-43be-aeb7-e6f998bdaed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-20a2e8ed-7594-4e85-a486-ba0210ebf4fb tempest-VolumesSnapshotTestJSON-1068079177 None] Created volume successfully. Apr 25 02:13:03 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 Apr 25 02:13:03 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:04 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8" returned: 0 in 0.522s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f4c725-9755-4a75-b1a9-34795cf086d6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:04 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 Apr 25 02:13:04 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-62cfafba-2fd8-412d-88a9-b8165eb0f3ce-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-62cfafba-2fd8-412d-88a9-b8165eb0f3ce-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f384ee-cdf4-4c6c-b522-8dad3b0677c9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:04 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce Apr 25 02:13:04 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:04 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8" returned: 0 in 0.545s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.8117f8be-1c50-4df1-a2b2-a0474747766bwlmba5y2.img {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:04 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.8117f8be-1c50-4df1-a2b2-a0474747766bwlmba5y2.img Apr 25 02:13:04 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:05 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" returned: 0 in 0.522s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:05 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce Apr 25 02:13:05 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:05 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" returned: 0 in 0.790s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-62cfafba-2fd8-412d-88a9-b8165eb0f3ce" released by "delete_volume" :: held 1.362s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:05 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=142,cinder:UPDATE=129,cinder:INSERT=23,cinder:DELETE=7 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Created reservations ['6bfbfb2e-0b46-4ece-82ab-cb2e07508cfe', '766463c2-a617-483e-a078-7d816c52b9b2', '29a3127a-7021-4464-8c60-833da2aca32f', 'd791fc22-a70d-4afb-96e1-9a31b57258fd'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:06 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:13:06 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-4d41cb8c-c49d-4aba-bb10-83808cb27cd4-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-4d41cb8c-c49d-4aba-bb10-83808cb27cd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-42f18c83-2622-485f-9768-f97e9c996239" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-42f18c83-2622-485f-9768-f97e9c996239" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-4d41cb8c-c49d-4aba-bb10-83808cb27cd4" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-4d41cb8c-c49d-4aba-bb10-83808cb27cd4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Deleting offline snapshot 4d41cb8c-c49d-4aba-bb10-83808cb27cd4 of volume 42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:13:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] snapshot_file for this snap is: volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:13:07 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08069d8-79f7-41be-8ed9-f498baa768ca]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:07 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 Apr 25 02:13:07 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:07 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.301s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:07 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:13:07 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Deleted volume successfully. Apr 25 02:13:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-183ceab2-b09f-475c-9288-5c8ff75dc165 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-62cfafba-2fd8-412d-88a9-b8165eb0f3ce-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:08 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4" returned: 0 in 1.045s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42f18c83-2622-485f-9768-f97e9c996239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:13:08 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cabd97-cc03-4e80-aa1d-66ce98c57ff3]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:08 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 Apr 25 02:13:08 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:09 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239" returned: 0 in 1.396s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:09 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 Apr 25 02:13:09 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:09 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.8117f8be-1c50-4df1-a2b2-a0474747766bwlmba5y2.img" returned: 0 in 5.073s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:09 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcdc81f-0088-4b26-af8a-310096abeece]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:09 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 Apr 25 02:13:09 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:10 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4" returned: 0 in 0.633s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:10 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4 Apr 25 02:13:10 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:10 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8" returned: 0 in 0.654s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.8117f8be-1c50-4df1-a2b2-a0474747766bwlmba5y2.img {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:13:10 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Converted 1024.00 MB image at 201.80 MB/s Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] 8117f8be-1c50-4df1-a2b2-a0474747766b was raw, no need to convert to raw {{(pid=81927) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 25 02:13:10 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239.4d41cb8c-c49d-4aba-bb10-83808cb27cd4" returned: 0 in 0.466s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-4d41cb8c-c49d-4aba-bb10-83808cb27cd4" released by "_delete_snapshot" :: held 3.762s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-42f18c83-2622-485f-9768-f97e9c996239" released by "delete_snapshot" :: held 3.798s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Created reservations ['ad970f1b-ec70-486f-9c4a-5a1427d88d71', '79deb8f8-38f7-40f0-820d-6caeb2834069', '359df8e2-41da-4265-9991-660561c52fbe', 'b85a6933-159f-4eb6-853c-4ca6db6549e7'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:13:10 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Delete snapshot completed successfully. Apr 25 02:13:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22975468-6a78-447c-993d-7d1bb36295ae tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-4d41cb8c-c49d-4aba-bb10-83808cb27cd4-delete_snapshot" released by "delete_snapshot" :: held 3.937s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:11 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:13:11 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-42f18c83-2622-485f-9768-f97e9c996239-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-42f18c83-2622-485f-9768-f97e9c996239-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-42f18c83-2622-485f-9768-f97e9c996239" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-42f18c83-2622-485f-9768-f97e9c996239" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[325e0ea1-2c8d-48e2-81e2-f6110ec087ee]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:11 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 Apr 25 02:13:11 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:11 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.502s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:13:11 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239" returned: 0 in 0.600s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:11 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239 Apr 25 02:13:11 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:12 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-42f18c83-2622-485f-9768-f97e9c996239" returned: 0 in 0.510s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-42f18c83-2622-485f-9768-f97e9c996239" released by "delete_volume" :: held 1.182s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:12 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Created reservations ['5f2e4ae3-ce03-42c4-b881-5ff92cc88d80', 'd8a1ab24-a06e-4bce-91ef-3104112136da', '3eb62d7c-90c9-4cc3-a2b5-7b2f8f7c4cd0', '2860e2cb-3201-4647-aa0d-e4710f946d2a'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:13:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:12 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:13:12 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:13 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.493s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:13:13 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Deleted volume successfully. Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-eb9bdee6-d70e-440c-ade2-b07ce7ba6f39 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-42f18c83-2622-485f-9768-f97e9c996239-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (b48dc04d-6287-4654-899d-05ae345b6748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef66c70-d40e-452e-83f9-92c83913f6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef66c70-d40e-452e-83f9-92c83913f6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605737797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca8f749-b02a-48de-9f51-5f84ba5c8c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f01066624c244a39d9675a5d9514d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:14Z,use_quota=True,user_id='36e819e8a9f84215b5235c604fa721e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bcfeb8-5baf-41b3-a96a-29e589aaa597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bcfeb8-5baf-41b3-a96a-29e589aaa597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5af632-970d-47ac-87e6-db71b9954826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5af632-970d-47ac-87e6-db71b9954826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca8f749-b02a-48de-9f51-5f84ba5c8c00', 'volume_name': 'volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84703a6e-1039-4699-88ca-11a5cdc13075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84703a6e-1039-4699-88ca-11a5cdc13075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f97fab-6c5a-459a-bb5e-1d28122bf61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:13 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Volume 0ca8f749-b02a-48de-9f51-5f84ba5c8c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00', 'volume_size': 1} Apr 25 02:13:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:23 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=25 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:13:23 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=68,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=3 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 22.122s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Uploaded volume to glance image-id: 8117f8be-1c50-4df1-a2b2-a0474747766b. {{(pid=81927) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.707s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f825b4c-b3c3-49ea-b520-5a1ee3d52a3d,created_at=2026-04-25T00:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-371628404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f825b4c-b3c3-49ea-b520-5a1ee3d52a3d,host='devstack@QuobyteHD#QuobyteHD',id=8139c86a-9e11-4552-91c2-2446a3d0ffd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba74895739a43aba2d0cc9a7e7b10cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:00Z,use_quota=True,user_id='b685c708f49c4085942cb90243e58a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ebe7a52-ecbf-470a-93ee-614a9c3ab001),volume_type_id=0ebe7a52-ecbf-470a-93ee-614a9c3ab001)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Creating volume 8139c86a-9e11-4552-91c2-2446a3d0ffd2 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:13:25 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:13:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:25 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 1073741824 Apr 25 02:13:25 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:25 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4d0ac94e-e5a5-4245-93bd-6c7893336c36 tempest-VolumesActionsTest-779239255 None] Copy volume to image completed successfully. Apr 25 02:13:26 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 1073741824" returned: 0 in 0.583s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:26 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 Apr 25 02:13:26 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:26 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2" returned: 0 in 0.445s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.885s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-605737797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca8f749-b02a-48de-9f51-5f84ba5c8c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f01066624c244a39d9675a5d9514d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:14Z,use_quota=True,user_id='36e819e8a9f84215b5235c604fa721e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Creating volume 0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:13:26 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:26 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 1073741824 Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06660840-7d16-4ffb-86ef-240261c61ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:26 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b57aa97-1746-4198-a319-da3843f61197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:26 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Volume volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 (8139c86a-9e11-4552-91c2-2446a3d0ffd2): created successfully Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b57aa97-1746-4198-a319-da3843f61197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Flow 'volume_create_manager' (b4a23471-c682-457d-866d-af4b27d82b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:26 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d4f91d52-172e-428d-a5b0-076d1806b065 tempest-GroupsTest-1597014103 None] Created volume successfully. Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Flow 'volume_create_manager' (1728f0f1-6035-43b0-96d7-2569631a9137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9527ac72-827c-404d-b743-f1787de16cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9527ac72-827c-404d-b743-f1787de16cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1057654294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f825b4c-b3c3-49ea-b520-5a1ee3d52a3d,host='devstack@QuobyteHD#QuobyteHD',id=d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba74895739a43aba2d0cc9a7e7b10cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:27Z,use_quota=True,user_id='b685c708f49c4085942cb90243e58a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ebe7a52-ecbf-470a-93ee-614a9c3ab001),volume_type_id=0ebe7a52-ecbf-470a-93ee-614a9c3ab001)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2662dea3-183d-4165-a78e-d54b67e52d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2662dea3-183d-4165-a78e-d54b67e52d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa61de2-2402-4125-a4eb-6fea34d40b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa61de2-2402-4125-a4eb-6fea34d40b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78cd3e2-0fe3-47ff-98a4-a220c4a65e6f', 'volume_name': 'volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a12a113-c91d-4a3b-a260-5eaa240f35c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a12a113-c91d-4a3b-a260-5eaa240f35c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4497a997-a435-4e27-b976-81cfbd143c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:27 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Volume d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f', 'volume_size': 1} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:27 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 1073741824" returned: 0 in 0.769s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:27 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 Apr 25 02:13:27 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:28 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" returned: 0 in 0.463s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f825b4c-b3c3-49ea-b520-5a1ee3d52a3d,created_at=2026-04-25T00:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1057654294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f825b4c-b3c3-49ea-b520-5a1ee3d52a3d,host='devstack@QuobyteHD#QuobyteHD',id=d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba74895739a43aba2d0cc9a7e7b10cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:27Z,use_quota=True,user_id='b685c708f49c4085942cb90243e58a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ebe7a52-ecbf-470a-93ee-614a9c3ab001),volume_type_id=0ebe7a52-ecbf-470a-93ee-614a9c3ab001)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Creating volume d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:13:28 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f97fab-6c5a-459a-bb5e-1d28122bf61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e58adb9-43a2-4980-8286-9ecfb126d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:28 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f 1073741824 Apr 25 02:13:28 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:28 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Volume volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 (0ca8f749-b02a-48de-9f51-5f84ba5c8c00): created successfully Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e58adb9-43a2-4980-8286-9ecfb126d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (b48dc04d-6287-4654-899d-05ae345b6748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d0078677-9faa-4afd-94ff-28a475cf24b7 tempest-VolumesSnapshotTestJSON-1068079177 None] Created volume successfully. Apr 25 02:13:28 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f 1073741824" returned: 0 in 0.651s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:28 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f Apr 25 02:13:28 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:29 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f" returned: 0 in 0.460s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.581s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4497a997-a435-4e27-b976-81cfbd143c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8e3f65-97b7-4e1e-801a-aee1dae8cd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e359567b-4253-4f77-acc3-8086b5562614]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Volume volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f (d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f): created successfully Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8e3f65-97b7-4e1e-801a-aee1dae8cd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Flow 'volume_create_manager' (1728f0f1-6035-43b0-96d7-2569631a9137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:29 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c1f821e7-1a99-4e66-a5ea-b2b8a335d6c5 tempest-GroupsTest-1597014103 None] Created volume successfully. Apr 25 02:13:29 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 Apr 25 02:13:29 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:29 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a5552856-94d6-4f79-9194-d58f0aa1ae26 tempest-GroupsTest-1597014103 None] Update group completed successfully. Apr 25 02:13:29 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8" returned: 0 in 0.572s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c1e5a9-32d9-413d-9bd4-80f821dc74f2]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:29 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 Apr 25 02:13:29 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:30 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8" returned: 0 in 0.526s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:30 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img Apr 25 02:13:30 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-607a201b-b916-4b9e-b5c5-cddf438eb8c5 tempest-GroupsTest-1597014103 None] Update group completed successfully. Apr 25 02:13:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Acquiring lock "cinder-quobyte-8139c86a-9e11-4552-91c2-2446a3d0ffd2" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Lock "cinder-quobyte-8139c86a-9e11-4552-91c2-2446a3d0ffd2" acquired by "delete_volume" :: waited 0.034s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:33 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[9254c326-83ce-4a35-97ed-0410aad5a98e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:33 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 Apr 25 02:13:33 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:34 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2" returned: 0 in 1.149s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:34 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2 Apr 25 02:13:34 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:35 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8139c86a-9e11-4552-91c2-2446a3d0ffd2" returned: 0 in 0.964s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Lock "cinder-quobyte-8139c86a-9e11-4552-91c2-2446a3d0ffd2" released by "delete_volume" :: held 2.185s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Acquiring lock "cinder-quobyte-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:35 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img" returned: 0 in 4.779s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Lock "cinder-quobyte-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d948c362-bef9-495e-ac04-7b8143d7d8b8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbab402-766c-4eb4-a81b-1b84fab288b4]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:35 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 Apr 25 02:13:35 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:35 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f Apr 25 02:13:35 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:35 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f" returned: 0 in 0.542s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:35 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f Apr 25 02:13:35 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:35 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8" returned: 0 in 0.655s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:13:35 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Converted 1024.00 MB image at 214.25 MB/s Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] 52f873fc-6ad5-4d88-856a-f70350ff4f30 was raw, converting to qcow2 {{(pid=81927) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d66da21-f143-4e43-ab3d-85b7b43585a3]: (4, 'raw') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:35 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img Apr 25 02:13:35 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:36 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f" returned: 0 in 0.414s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Lock "cinder-quobyte-d78cd3e2-0fe3-47ff-98a4-a220c4a65e6f" released by "delete_volume" :: held 0.999s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Created reservations ['56b7fc98-a241-4103-bc58-297d6c27582a'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:13:36 devstack cinder-volume[81927]: WARNING cinder.quota [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1688901426 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1688901426, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:13:36 devstack cinder-volume[81927]: WARNING cinder.quota [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1688901426 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1688901426, it is now deprecated. Please use the default quota class for default quota. Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Created reservations ['425cb428-2763-4ac2-a1bf-57eef13fcefa', '3059cc63-da91-481b-ab7a-f993a8d0fc9f', '3126c301-62ab-4def-8c98-b0faf84ce537', 'e2f6fa57-941b-4c90-b074-cdd49438dc0f'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:13:36 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img" returned: 0 in 0.513s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Created reservations ['68a2be9a-69d2-4ec9-a883-5e68b1e16cc7', 'f733f39b-4d9e-4b52-886a-e76018b4837e', '6b5fd1bf-4140-462d-84f4-ebf51a989134', 'd90b853a-a733-4ec8-8331-1461f02e01ea'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:13:36 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img Apr 25 02:13:36 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:36 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:13:36 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:36 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img" returned: 1 in 0.519s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img' failed. Not Retrying. {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 02:13:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img /opt/stack/data/cinder/conversion/vol_upload_j4rk07is {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:36 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img /opt/stack/data/cinder/conversion/vol_upload_j4rk07is Apr 25 02:13:36 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:37 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.468s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:37 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:13:37 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-2f7af4db-ddb2-437d-8350-71610bedcbb0 tempest-GroupsTest-1597014103 None] Delete group completed successfully. Apr 25 02:13:37 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img /opt/stack/data/cinder/conversion/vol_upload_j4rk07is" returned: 0 in 0.441s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:37 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Image conversion details: src /opt/stack/data/cinder/conversion/dad05125-5a05-4996-91eb-16bde54e43b8.temp_image.52f873fc-6ad5-4d88-856a-f70350ff4f30zs4au0wi.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_j4rk07is {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:13:37 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 25 02:13:37 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf936b7-6be3-40c5-aa11-b9a81b8fb238]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j4rk07is {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:37 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j4rk07is Apr 25 02:13:37 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:37 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_j4rk07is" returned: 0 in 0.560s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.053s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Uploaded volume to glance image-id: 52f873fc-6ad5-4d88-856a-f70350ff4f30. {{(pid=81927) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 25 02:13:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.390s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Creating offline snapshot 8aa77841-1212-4408-88c3-6e414c1be98d of volume 0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:13:39 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-cad36466-fea3-4c20-aa95-c4340a6f65fc tempest-VolumesActionsTest-779239255 None] Copy volume to image completed successfully. Apr 25 02:13:39 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a1685-b396-49a9-a24f-86fcdac4561b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:39 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 Apr 25 02:13:39 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:39 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" returned: 0 in 0.580s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:39 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d 1G Apr 25 02:13:39 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:40 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d 1G" returned: 0 in 0.716s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:40 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d Apr 25 02:13:40 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Acquiring lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Acquiring lock "cinder-quobyte-dad05125-5a05-4996-91eb-16bde54e43b8" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Lock "cinder-quobyte-dad05125-5a05-4996-91eb-16bde54e43b8" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e7abb7-4233-49fd-accc-f36e68cc2040]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:40 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 Apr 25 02:13:40 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:41 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d" returned: 0 in 0.566s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:41 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d is being set with open permissions: ugo+rw Apr 25 02:13:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:41 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d Apr 25 02:13:41 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:41 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8" returned: 0 in 0.559s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:41 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8 Apr 25 02:13:41 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:41 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d" returned: 0 in 0.561s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:41 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.info Apr 25 02:13:41 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:41 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dad05125-5a05-4996-91eb-16bde54e43b8" returned: 0 in 0.490s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Lock "cinder-quobyte-dad05125-5a05-4996-91eb-16bde54e43b8" released by "delete_volume" :: held 1.100s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:41 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Created reservations ['ab2cfd09-e7d9-4367-976d-7184ad06e98f', '684a773d-300b-4c26-9c81-02230210cf35', 'd8b17301-0a94-4a9e-86ec-7ccf9fe67f22', 'a0b3648a-df1f-468f-b2ad-77f8cbd7c91d'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:42 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:13:42 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:42 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.info" returned: 0 in 0.468s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:42 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.info is being set with open permissions: ugo+rw Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:42 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.info Apr 25 02:13:42 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:42 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.581s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:13:42 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Deleted volume successfully. Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-f92e8119-4ef7-49af-a891-08d01f950adc tempest-VolumesActionsTest-779239255 None] Lock "cinder-dad05125-5a05-4996-91eb-16bde54e43b8-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:42 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.info" returned: 0 in 0.580s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.577s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:42 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d8e7ea7e-2180-40e2-ae88-57ce72334483 tempest-VolumesSnapshotTestJSON-1068079177 None] Create snapshot completed successfully Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (448a4510-bb39-432a-9578-c78eb1b0d7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d30a41-af94-4e77-a1e1-58e24e93513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d30a41-af94-4e77-a1e1-58e24e93513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875433211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9291dc-3621-4395-89b3-0add2471acf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f01066624c244a39d9675a5d9514d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8aa77841-1212-4408-88c3-6e414c1be98d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:44Z,use_quota=True,user_id='36e819e8a9f84215b5235c604fa721e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a014e6d0-a1e1-4f3c-8077-9942ea74b8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a014e6d0-a1e1-4f3c-8077-9942ea74b8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0a76b5-5d14-40ff-a854-d864847b48d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0a76b5-5d14-40ff-a854-d864847b48d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4d9291dc-3621-4395-89b3-0add2471acf7', 'volume_name': 'volume-4d9291dc-3621-4395-89b3-0add2471acf7', 'volume_size': 1, 'snapshot_id': '8aa77841-1212-4408-88c3-6e414c1be98d'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907c610d-8005-426c-8a84-4e6b018f7697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907c610d-8005-426c-8a84-4e6b018f7697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1428abf5-78d6-49a3-89a2-9f37440319d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:44 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Volume 4d9291dc-3621-4395-89b3-0add2471acf7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4d9291dc-3621-4395-89b3-0add2471acf7', 'volume_size': 1, 'snapshot_id': '8aa77841-1212-4408-88c3-6e414c1be98d'} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-8aa77841-1212-4408-88c3-6e414c1be98d-4d9291dc-3621-4395-89b3-0add2471acf7" by "_create_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-8aa77841-1212-4408-88c3-6e414c1be98d-4d9291dc-3621-4395-89b3-0add2471acf7" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Creating volume 4d9291dc-3621-4395-89b3-0add2471acf7 from snapshot 8aa77841-1212-4408-88c3-6e414c1be98d {{(pid=81927) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-4d9291dc-3621-4395-89b3-0add2471acf7" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-4d9291dc-3621-4395-89b3-0add2471acf7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] snapshot: 8aa77841-1212-4408-88c3-6e414c1be98d, volume: 4d9291dc-3621-4395-89b3-0add2471acf7, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[34441594-60b3-4228-ba52-4d93593b44d1]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:44 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d Apr 25 02:13:44 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:44 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d" returned: 0 in 0.627s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea7e08e-847f-4630-a3d3-291d4b97b2a7]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:45 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 Apr 25 02:13:45 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:45 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" returned: 0 in 0.648s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:45 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:13:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:45 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 Apr 25 02:13:45 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Flow 'volume_create_manager' (0290a1f7-d00d-473b-bb8c-e893d3fd931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e374ab-df75-47c7-ac66-8cb4f45f133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e374ab-df75-47c7-ac66-8cb4f45f133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-260974705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114c0152-2d79-453c-b864-7c1360a4883d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb5a5fffb354c4d862237fa4b7c288a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:51Z,use_quota=True,user_id='c30c734e61d74d95b8da7f829d38b91f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750d2668-dabb-44de-a047-efe6efa1d5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750d2668-dabb-44de-a047-efe6efa1d5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80d619b-b1a5-4473-aee1-aec9fd51eaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80d619b-b1a5-4473-aee1-aec9fd51eaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114c0152-2d79-453c-b864-7c1360a4883d', 'volume_name': 'volume-114c0152-2d79-453c-b864-7c1360a4883d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c3cee2-442a-4966-bcf3-2fb6b2e76233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c3cee2-442a-4966-bcf3-2fb6b2e76233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544f7d82-9355-4d2f-872c-7086f9fecfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Volume 114c0152-2d79-453c-b864-7c1360a4883d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114c0152-2d79-453c-b864-7c1360a4883d', 'volume_size': 1} Apr 25 02:13:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:52 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7" returned: 0 in 6.391s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c9e232-7c58-46a1-981b-6823de8067cd]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Flow 'volume_create_manager' (0dac6478-97d7-4e7b-971b-4a1d61f1b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab6a4f0-2f4d-4400-9b42-65bd814010be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab6a4f0-2f4d-4400-9b42-65bd814010be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1856759851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6cb429-f150-4627-9415-a86e839483a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0196b14322614a90b8ce005359b3f328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:52Z,use_quota=True,user_id='ad61321988e64410b3aea1a52958b2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06de17b-a7b6-4b93-a921-1cae7dd38120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06de17b-a7b6-4b93-a921-1cae7dd38120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc5b1b1-e978-47c4-b6bc-2fe238c8f66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc5b1b1-e978-47c4-b6bc-2fe238c8f66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6cb429-f150-4627-9415-a86e839483a0', 'volume_name': 'volume-ba6cb429-f150-4627-9415-a86e839483a0', 'volume_size': 2}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:52 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 Apr 25 02:13:52 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba74e764-034e-4f80-a7e6-97551a859b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba74e764-034e-4f80-a7e6-97551a859b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d63585-d8a5-4114-a2e8-4f2090d6507e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Volume ba6cb429-f150-4627-9415-a86e839483a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6cb429-f150-4627-9415-a86e839483a0', 'volume_size': 2} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:52 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" returned: 0 in 0.654s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:13:52 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Converted 1024.00 MB image at 160.18 MB/s Apr 25 02:13:52 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 is being set with open permissions: ugo+rw Apr 25 02:13:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:52 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 Apr 25 02:13:52 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:53 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7" returned: 0 in 0.448s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-4d9291dc-3621-4395-89b3-0add2471acf7" released by "_copy_volume_from_snapshot" :: held 8.879s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-8aa77841-1212-4408-88c3-6e414c1be98d-4d9291dc-3621-4395-89b3-0add2471acf7" released by "_create_volume_from_snapshot" :: held 8.918s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.941s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-260974705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114c0152-2d79-453c-b864-7c1360a4883d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb5a5fffb354c4d862237fa4b7c288a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:51Z,use_quota=True,user_id='c30c734e61d74d95b8da7f829d38b91f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Creating volume 114c0152-2d79-453c-b864-7c1360a4883d {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:13:53 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:53 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d 1073741824 Apr 25 02:13:53 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1428abf5-78d6-49a3-89a2-9f37440319d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9291dc-3621-4395-89b3-0add2471acf7', 'volume_size': 1, 'snapshot_id': '8aa77841-1212-4408-88c3-6e414c1be98d'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d98508-47ae-4c08-a06d-66d6e11e6ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:53 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Volume volume-4d9291dc-3621-4395-89b3-0add2471acf7 (4d9291dc-3621-4395-89b3-0add2471acf7): created successfully Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d98508-47ae-4c08-a06d-66d6e11e6ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Flow 'volume_create_manager' (448a4510-bb39-432a-9578-c78eb1b0d7e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:53 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-7204decd-cd49-4308-9bd2-5eaf46a44f3c tempest-VolumesSnapshotTestJSON-1068079177 None] Created volume successfully. Apr 25 02:13:53 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d 1073741824" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:53 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d Apr 25 02:13:53 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:54 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d" returned: 0 in 0.444s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.118s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1856759851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6cb429-f150-4627-9415-a86e839483a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0196b14322614a90b8ce005359b3f328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:13:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:13:52Z,use_quota=True,user_id='ad61321988e64410b3aea1a52958b2b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Creating volume ba6cb429-f150-4627-9415-a86e839483a0 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:13:54 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 2147483648 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544f7d82-9355-4d2f-872c-7086f9fecfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114c0152-2d79-453c-b864-7c1360a4883d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fdef90-90b1-458d-92dc-b744102e0451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:54 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 2147483648 Apr 25 02:13:54 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:54 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Volume volume-114c0152-2d79-453c-b864-7c1360a4883d (114c0152-2d79-453c-b864-7c1360a4883d): created successfully Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fdef90-90b1-458d-92dc-b744102e0451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Flow 'volume_create_manager' (0290a1f7-d00d-473b-bb8c-e893d3fd931d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:54 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c2e6da1e-62ee-44af-8ab1-2829bca95ffd tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Created volume successfully. Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-4d9291dc-3621-4395-89b3-0add2471acf7-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-4d9291dc-3621-4395-89b3-0add2471acf7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-4d9291dc-3621-4395-89b3-0add2471acf7" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-4d9291dc-3621-4395-89b3-0add2471acf7" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4713f9-dc0e-46f4-aeec-c1a7403e25e2]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:54 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 Apr 25 02:13:54 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:54 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 2147483648" returned: 0 in 0.695s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:54 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7" returned: 0 in 0.555s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:55 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 Apr 25 02:13:55 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:55 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7 Apr 25 02:13:55 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:55 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0" returned: 0 in 0.431s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d63585-d8a5-4114-a2e8-4f2090d6507e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6cb429-f150-4627-9415-a86e839483a0', 'volume_size': 2}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b66d77-8363-4bd7-8334-46f24a15903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:13:55 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Volume volume-ba6cb429-f150-4627-9415-a86e839483a0 (ba6cb429-f150-4627-9415-a86e839483a0): created successfully Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b66d77-8363-4bd7-8334-46f24a15903f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Flow 'volume_create_manager' (0dac6478-97d7-4e7b-971b-4a1d61f1b934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:13:55 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-4d9291dc-3621-4395-89b3-0add2471acf7" returned: 0 in 0.483s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:55 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-cb276f49-bc48-4873-a63b-f21ae8617073 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Created volume successfully. Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-4d9291dc-3621-4395-89b3-0add2471acf7" released by "delete_volume" :: held 1.088s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Created reservations ['af648c45-ff8d-457e-bb94-eaf979472519', '596dd874-95ed-48bf-926a-b566a4a7f1e5', '549df7cb-4d70-4fd4-a303-c0404aed0434', '733fed7e-e591-48fb-97cc-3763be581a76'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Creating offline snapshot c3c07343-ffc9-4819-8bbc-fdbaef475183 of volume 114c0152-2d79-453c-b864-7c1360a4883d {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[308d416f-ab98-4d89-9c08-2adc4fc546e2]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:55 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:13:55 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:55 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d Apr 25 02:13:55 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:56 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.442s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:13:56 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Deleted volume successfully. Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5c99bc0-7c8d-4b9e-8bff-a7e23725a554 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-4d9291dc-3621-4395-89b3-0add2471acf7-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:56 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d" returned: 0 in 0.527s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:56 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 1G Apr 25 02:13:56 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-8aa77841-1212-4408-88c3-6e414c1be98d-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-8aa77841-1212-4408-88c3-6e414c1be98d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-8aa77841-1212-4408-88c3-6e414c1be98d" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-8aa77841-1212-4408-88c3-6e414c1be98d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Deleting offline snapshot 8aa77841-1212-4408-88c3-6e414c1be98d of volume 0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] snapshot_file for this snap is: volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ed4cdb-c49f-4550-a397-1b80c2105ad6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:56 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 1G" returned: 0 in 0.630s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114c0152-2d79-453c-b864-7c1360a4883d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:56 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d Apr 25 02:13:56 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:56 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114c0152-2d79-453c-b864-7c1360a4883d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 Apr 25 02:13:56 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:57 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d" returned: 0 in 0.527s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[50348ad1-eb42-4fb6-b5b5-947e75fd6153]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:57 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114c0152-2d79-453c-b864-7c1360a4883d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183" returned: 0 in 0.494s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:57 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 is being set with open permissions: ugo+rw Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:57 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 Apr 25 02:13:57 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:57 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 Apr 25 02:13:57 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:57 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183" returned: 0 in 0.463s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:57 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" returned: 0 in 0.518s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:57 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.info Apr 25 02:13:57 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:57 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d Apr 25 02:13:57 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:58 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.info" returned: 0 in 0.466s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:58 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.info is being set with open permissions: ugo+rw Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:58 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.info Apr 25 02:13:58 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:58 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d" returned: 0 in 0.532s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:58 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d Apr 25 02:13:58 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:58 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.info" returned: 0 in 0.427s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.127s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.302s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Creating offline snapshot 44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f of volume ba6cb429-f150-4627-9415-a86e839483a0 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2b9a18-57b1-4eb2-8a24-bc15da6e5f4b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:58 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-64622c41-dac5-4638-8579-b2cc602ee24b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Create snapshot completed successfully Apr 25 02:13:58 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00.8aa77841-1212-4408-88c3-6e414c1be98d" returned: 0 in 0.476s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:58 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 Apr 25 02:13:58 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-8aa77841-1212-4408-88c3-6e414c1be98d" released by "_delete_snapshot" :: held 2.154s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" released by "delete_snapshot" :: held 2.181s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:58 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Created reservations ['5b643cb1-7eaf-4ef9-8652-46a69272fe06', '6d6da7dc-6d32-4924-962c-698c50b482ea', '169eba58-b23c-428b-a106-1c9d1d305b74', '87ef25fd-dbda-4128-814a-809078c2516f'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:13:58 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Delete snapshot completed successfully. Apr 25 02:13:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1068681d-d311-4aca-8597-5bd196f5a556 tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-8aa77841-1212-4408-88c3-6e414c1be98d-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:13:59 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 25 02:13:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0" returned: 0 in 0.531s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:13:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f 2G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:13:59 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f 2G Apr 25 02:13:59 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:13:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-0ca8f749-b02a-48de-9f51-5f84ba5c8c00-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:13:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-0ca8f749-b02a-48de-9f51-5f84ba5c8c00-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:13:59 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f 2G" returned: 0 in 0.680s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6cb429-f150-4627-9415-a86e839483a0 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:00 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6cb429-f150-4627-9415-a86e839483a0 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f Apr 25 02:14:00 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5766faa6-7fd3-43ab-9cad-cc7a986b93d1]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:00 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 Apr 25 02:14:00 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Acquiring lock "cinder-c3c07343-ffc9-4819-8bbc-fdbaef475183-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-c3c07343-ffc9-4819-8bbc-fdbaef475183-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Acquiring lock "cinder-quobyte-114c0152-2d79-453c-b864-7c1360a4883d" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-quobyte-114c0152-2d79-453c-b864-7c1360a4883d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Acquiring lock "cinder-quobyte-c3c07343-ffc9-4819-8bbc-fdbaef475183" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-quobyte-c3c07343-ffc9-4819-8bbc-fdbaef475183" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Deleting offline snapshot c3c07343-ffc9-4819-8bbc-fdbaef475183 of volume 114c0152-2d79-453c-b864-7c1360a4883d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] snapshot_file for this snap is: volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[016f13bc-167c-4eed-9e4a-a1a4f1b37891]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:00 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 Apr 25 02:14:00 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:00 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba6cb429-f150-4627-9415-a86e839483a0 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f" returned: 0 in 0.534s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:00 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f is being set with open permissions: ugo+rw Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:00 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f Apr 25 02:14:00 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:00 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" returned: 0 in 0.593s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:00 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00 Apr 25 02:14:00 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:00 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183" returned: 0 in 0.561s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114c0152-2d79-453c-b864-7c1360a4883d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5531273a-cd70-4f6e-aea1-b3d2cb55ed8a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:01 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:01 devstack sudo[88918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d Apr 25 02:14:01 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f" returned: 0 in 0.477s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:01 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.info Apr 25 02:14:01 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:01 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" returned: 0 in 0.461s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-0ca8f749-b02a-48de-9f51-5f84ba5c8c00" released by "delete_volume" :: held 1.122s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Created reservations ['af7c5f05-255d-441e-a7b5-add4f4b92079', '57054cae-3b47-495d-96e0-9dc3912eabb0', '96ec6ded-c207-426c-8eee-9623e90cdc19', 'd125b1ea-a208-42ee-a906-c6216bacdd69'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:01 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:14:01 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:01 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d" returned: 0 in 0.578s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:01 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 Apr 25 02:14:01 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:01 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.info" returned: 0 in 0.486s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:01 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.info is being set with open permissions: ugo+rw Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:01 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.info Apr 25 02:14:01 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:01 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.448s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:14:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Deleted volume successfully. Apr 25 02:14:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d6553a51-e69e-42f6-9b46-e54f4c0e683f tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-0ca8f749-b02a-48de-9f51-5f84ba5c8c00-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:02 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.info" returned: 0 in 0.496s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.316s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:02 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dc0a06d0-da8a-4329-bca2-d4ece4917a9f tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Create snapshot completed successfully Apr 25 02:14:02 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183 Apr 25 02:14:02 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-8baa874e-f4c8-463a-ae5f-361d7120e35c-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-8baa874e-f4c8-463a-ae5f-361d7120e35c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "cinder-quobyte-8baa874e-f4c8-463a-ae5f-361d7120e35c" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-8baa874e-f4c8-463a-ae5f-361d7120e35c" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aef0c0-2243-4334-93e6-86e642dfe52d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:02 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c Apr 25 02:14:02 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:02 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d.c3c07343-ffc9-4819-8bbc-fdbaef475183" returned: 0 in 0.483s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-quobyte-c3c07343-ffc9-4819-8bbc-fdbaef475183" released by "_delete_snapshot" :: held 2.305s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-quobyte-114c0152-2d79-453c-b864-7c1360a4883d" released by "delete_snapshot" :: held 2.334s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Created reservations ['96e2c1cb-2438-43f0-bff2-f23f85ea884e', '591a0a8f-3eed-4fb1-b3a0-e6fa5678a34d', 'fecf4522-6f0d-449d-81d3-f72a362be2ec', 'd852c2b3-a1d4-469c-9559-963e2434f484'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Delete snapshot completed successfully. Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-02af8eb8-8dcb-4e09-869f-1281e22156e7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-c3c07343-ffc9-4819-8bbc-fdbaef475183-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Acquiring lock "cinder-44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Acquiring lock "cinder-quobyte-ba6cb429-f150-4627-9415-a86e839483a0" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-quobyte-ba6cb429-f150-4627-9415-a86e839483a0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Acquiring lock "cinder-quobyte-44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-quobyte-44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Deleting offline snapshot 44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f of volume ba6cb429-f150-4627-9415-a86e839483a0 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] snapshot_file for this snap is: volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dde54b8-fc6a-45b1-a569-0eb31c94a4d5]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:02 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c" returned: 0 in 0.591s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:02 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c Apr 25 02:14:02 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:02 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f Apr 25 02:14:02 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:03 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8baa874e-f4c8-463a-ae5f-361d7120e35c" returned: 0 in 0.450s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-quobyte-8baa874e-f4c8-463a-ae5f-361d7120e35c" released by "delete_volume" :: held 1.094s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:03 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f" returned: 0 in 0.555s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba6cb429-f150-4627-9415-a86e839483a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a25b69-bcc4-4fb3-b2b7-116f1913bf1f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Created reservations ['7f5e278c-977f-4505-a4df-b694d9afeb4b', '47681881-2101-41fa-9bac-de6168704e76', 'a8ddf3a3-05d8-4e29-abd2-d63c97202a1f', '787fe089-4f63-4cde-b223-1953e6a174fd'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Acquiring lock "cinder-114c0152-2d79-453c-b864-7c1360a4883d-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-114c0152-2d79-453c-b864-7c1360a4883d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:03 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 Apr 25 02:14:03 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Acquiring lock "cinder-quobyte-114c0152-2d79-453c-b864-7c1360a4883d" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:03 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:14:03 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-quobyte-114c0152-2d79-453c-b864-7c1360a4883d" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4a3001-85f4-403c-b8fd-5fd68a6721a9]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:03 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d Apr 25 02:14:03 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:04 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.430s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:14:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Deleted volume successfully. Apr 25 02:14:04 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3eaab555-a5a5-48c4-9672-ab293389067d tempest-VolumesSnapshotTestJSON-1068079177 None] Lock "cinder-8baa874e-f4c8-463a-ae5f-361d7120e35c-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:04 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f Apr 25 02:14:04 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:04 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d" returned: 0 in 0.543s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:04 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d Apr 25 02:14:04 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:04 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f" returned: 0 in 0.546s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:04 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f Apr 25 02:14:04 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:04 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-114c0152-2d79-453c-b864-7c1360a4883d" returned: 0 in 0.505s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-quobyte-114c0152-2d79-453c-b864-7c1360a4883d" released by "delete_volume" :: held 1.106s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Created reservations ['81c1297a-cd31-42b7-9a34-2830a86f9e0c', 'e10d9a8c-cfa8-4cb7-b202-9b255fa96621', 'abe79419-cead-443d-9e3c-c6362f13b064', '42f5aa1d-6424-45c5-810a-a1bc1b0b0ac9'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:04 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:14:04 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:05 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0.44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f" returned: 0 in 0.528s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-quobyte-44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f" released by "_delete_snapshot" :: held 2.330s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-quobyte-ba6cb429-f150-4627-9415-a86e839483a0" released by "delete_snapshot" :: held 2.358s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:05 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Created reservations ['5a52f1c2-b36b-4b7c-854a-cb770f2dfe6a', 'd832c437-9331-4193-9f8c-b3b5beb3d8ba', '857ff314-5d1d-4895-a6b9-cb89a9591698', 'c88e67e6-a9ab-4514-b965-93a4e6554b6c'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:05 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Delete snapshot completed successfully. Apr 25 02:14:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-79b8e689-1f40-47d7-89b1-e713a095dca4 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-44d7ccd9-2fb9-4bb6-8aa1-c81f1f301c0f-delete_snapshot" released by "delete_snapshot" :: held 2.497s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:05 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.545s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:05 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:14:05 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Deleted volume successfully. Apr 25 02:14:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-fa37920a-6ab0-44eb-aa1e-65dbe4f1e75b tempest-VolumeSnapshotQuotasNegativeTestJSON-1192528616 None] Lock "cinder-114c0152-2d79-453c-b864-7c1360a4883d-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Acquiring lock "cinder-ba6cb429-f150-4627-9415-a86e839483a0-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-ba6cb429-f150-4627-9415-a86e839483a0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Acquiring lock "cinder-quobyte-ba6cb429-f150-4627-9415-a86e839483a0" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-quobyte-ba6cb429-f150-4627-9415-a86e839483a0" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:06 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[849c68ca-7f04-402f-9363-5d125dc93398]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:06 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 Apr 25 02:14:06 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:06 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0" returned: 0 in 0.659s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:06 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0 Apr 25 02:14:06 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:07 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ba6cb429-f150-4627-9415-a86e839483a0" returned: 0 in 0.567s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-quobyte-ba6cb429-f150-4627-9415-a86e839483a0" released by "delete_volume" :: held 1.321s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:07 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Created reservations ['0c4b8713-83d1-4b7c-9dcf-753eaf4406db', '75353ff4-c272-4828-a06f-cfd3c3b849c1', '622690c3-45c9-4016-8d4c-8d0247ed98c7', 'bf6d90f6-ccc2-42e9-a760-90a3ce20cc35'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:07 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:14:07 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:08 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.579s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:08 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:14:08 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Deleted volume successfully. Apr 25 02:14:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c0cbb3c5-3182-4962-9a6e-3dbe05bf1548 tempest-VolumesSnapshotNegativeTestJSON-1677571485 None] Lock "cinder-ba6cb429-f150-4627-9415-a86e839483a0-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Flow 'volume_create_manager' (eddc7db4-0ade-4a68-8e33-bccf4e446fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c78a64b-8613-43a5-ba6a-018d8272b73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c78a64b-8613-43a5-ba6a-018d8272b73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1050109661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23740829-227d-4e98-9b36-9d00965021d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9f9dd8c6e44ad3835c0f300a257e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:11Z,use_quota=True,user_id='73b4affbb4a3450ca689238380086f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b753975-5310-4ad7-8f34-9814f787d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b753975-5310-4ad7-8f34-9814f787d222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683a788c-0c34-4098-ba3f-113b98b4d8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683a788c-0c34-4098-ba3f-113b98b4d8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23740829-227d-4e98-9b36-9d00965021d5', 'volume_name': 'volume-23740829-227d-4e98-9b36-9d00965021d5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c36dba7-b6b1-4eb3-a1e2-2265624b6c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c36dba7-b6b1-4eb3-a1e2-2265624b6c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cac171e-37df-4dde-8e69-89acb4057169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:10 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Volume 23740829-227d-4e98-9b36-9d00965021d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23740829-227d-4e98-9b36-9d00965021d5', 'volume_size': 1} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1050109661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23740829-227d-4e98-9b36-9d00965021d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9f9dd8c6e44ad3835c0f300a257e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:11Z,use_quota=True,user_id='73b4affbb4a3450ca689238380086f27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Creating volume 23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:14:10 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:14:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:10 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 1073741824 Apr 25 02:14:10 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:11 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 1073741824" returned: 0 in 0.836s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:11 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 Apr 25 02:14:11 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:12 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5" returned: 0 in 0.486s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:14:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cac171e-37df-4dde-8e69-89acb4057169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23740829-227d-4e98-9b36-9d00965021d5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff35fa8-a477-424e-b867-6550d87ca122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:12 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Volume volume-23740829-227d-4e98-9b36-9d00965021d5 (23740829-227d-4e98-9b36-9d00965021d5): created successfully Apr 25 02:14:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff35fa8-a477-424e-b867-6550d87ca122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Flow 'volume_create_manager' (eddc7db4-0ade-4a68-8e33-bccf4e446fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:12 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d7b07cd2-e3c7-413d-9217-30477bd82da0 tempest-VolumesSnapshotListTestJSON-585330423 None] Created volume successfully. Apr 25 02:14:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:13 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Creating offline snapshot 6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d of volume 23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:14:13 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53606aa-7c29-4925-9d86-0188018afd01]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:13 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 Apr 25 02:14:13 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:13 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5" returned: 0 in 0.642s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:13 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d 1G Apr 25 02:14:13 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:14 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d 1G" returned: 0 in 0.717s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23740829-227d-4e98-9b36-9d00965021d5 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:14 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23740829-227d-4e98-9b36-9d00965021d5 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d Apr 25 02:14:14 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:15 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23740829-227d-4e98-9b36-9d00965021d5 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" returned: 0 in 0.651s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:15 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d is being set with open permissions: ugo+rw Apr 25 02:14:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:15 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d Apr 25 02:14:15 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:15 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:15 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.info Apr 25 02:14:15 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:16 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.info" returned: 0 in 0.515s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:16 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.info is being set with open permissions: ugo+rw Apr 25 02:14:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:16 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.info Apr 25 02:14:16 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:16 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.info" returned: 0 in 0.497s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.710s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:16 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5c1dcbaa-95e3-42ac-b42e-3a4fa2ef91a2 tempest-VolumesSnapshotListTestJSON-585330423 None] Create snapshot completed successfully Apr 25 02:14:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Creating offline snapshot 9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 of volume 23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:14:17 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0eca09-b097-42c7-83b0-835a3cd0da7e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:17 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d Apr 25 02:14:17 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:18 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" returned: 0 in 0.658s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23740829-227d-4e98-9b36-9d00965021d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:18 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 1G Apr 25 02:14:18 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:19 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 1G" returned: 0 in 0.776s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:19 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 Apr 25 02:14:19 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:19 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" returned: 0 in 0.660s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:19 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 is being set with open permissions: ugo+rw Apr 25 02:14:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:19 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 Apr 25 02:14:19 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:20 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" returned: 0 in 0.608s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:20 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3bdc6544-133b-4934-9230-5973e15b5772 tempest-VolumesSnapshotListTestJSON-585330423 None] Create snapshot completed successfully Apr 25 02:14:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Creating offline snapshot 53baa0e7-5c02-4c01-ac07-21b1ad35a27f of volume 23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:14:20 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[78612df1-2b74-4856-9b0a-09fecfc91210]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:21 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 Apr 25 02:14:21 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:21 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" returned: 0 in 0.594s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23740829-227d-4e98-9b36-9d00965021d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:21 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f 1G Apr 25 02:14:21 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:22 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f 1G" returned: 0 in 0.808s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:22 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f Apr 25 02:14:22 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:22 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f" returned: 0 in 0.542s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:22 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f is being set with open permissions: ugo+rw Apr 25 02:14:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:22 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f Apr 25 02:14:22 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:23 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f" returned: 0 in 0.511s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:23 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9cb709a2-48a4-4c1a-8394-31645cb9d84d tempest-VolumesSnapshotListTestJSON-585330423 None] Create snapshot completed successfully Apr 25 02:14:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-53baa0e7-5c02-4c01-ac07-21b1ad35a27f-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-53baa0e7-5c02-4c01-ac07-21b1ad35a27f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-quobyte-53baa0e7-5c02-4c01-ac07-21b1ad35a27f" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-53baa0e7-5c02-4c01-ac07-21b1ad35a27f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Deleting offline snapshot 53baa0e7-5c02-4c01-ac07-21b1ad35a27f of volume 23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:14:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] snapshot_file for this snap is: volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:14:25 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790527b-e4d9-4ddb-8f48-23a61f2504ff]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:25 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f Apr 25 02:14:25 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:25 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f" returned: 0 in 0.738s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23740829-227d-4e98-9b36-9d00965021d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:25 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[505d4660-5c39-4bdc-92a1-88c6ad7c9e2e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:25 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 Apr 25 02:14:25 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:26 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" returned: 0 in 0.703s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23740829-227d-4e98-9b36-9d00965021d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:26 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f Apr 25 02:14:26 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:27 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f" returned: 0 in 0.888s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:27 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f Apr 25 02:14:27 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:27 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.53baa0e7-5c02-4c01-ac07-21b1ad35a27f" returned: 0 in 0.597s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-53baa0e7-5c02-4c01-ac07-21b1ad35a27f" released by "_delete_snapshot" :: held 3.037s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" released by "delete_snapshot" :: held 3.069s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:28 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=100,cinder:UPDATE=106,cinder:INSERT=31,cinder:DELETE=8 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:14:28 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=120,cinder:INSERT=24,cinder:DELETE=11,cinder:SELECT=99 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:14:28 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Created reservations ['8443904e-5448-481f-b22b-d862c6d9921a', '9604109e-0a7a-48da-b23d-51b04ea21461', 'b7c5a6a8-135a-4436-9c9f-35c085c9a002', 'e7a3cb21-e811-4649-ac6f-b174c91cb673'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Delete snapshot completed successfully. Apr 25 02:14:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e1021c4e-9219-4f22-b61f-74310ae01b5e tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-53baa0e7-5c02-4c01-ac07-21b1ad35a27f-delete_snapshot" released by "delete_snapshot" :: held 3.272s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-quobyte-9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Deleting offline snapshot 9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 of volume 23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] snapshot_file for this snap is: volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[29079800-5a0d-4b1f-a6da-13b1f5391205]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:29 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 Apr 25 02:14:29 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:30 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" returned: 0 in 0.751s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23740829-227d-4e98-9b36-9d00965021d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:30 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee0189a-d2a8-40a5-a05e-930e9021b4a3]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:30 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d Apr 25 02:14:30 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:30 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" returned: 0 in 0.584s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23740829-227d-4e98-9b36-9d00965021d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:30 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 Apr 25 02:14:30 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:31 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" returned: 0 in 0.736s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:31 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3 Apr 25 02:14:31 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:32 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" returned: 0 in 0.565s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3" released by "_delete_snapshot" :: held 2.735s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" released by "delete_snapshot" :: held 2.769s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Created reservations ['f0af0d86-5327-4482-aa94-cfd2c47e0aa4', '44c51359-c314-4ac4-8f09-e7818a2c87a0', 'dd7ff107-f575-4409-a32f-5900cca61cc1', 'ee47a292-3e0f-4a87-be14-8a610aee6098'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:32 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Delete snapshot completed successfully. Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0b7d1757-f7c3-4748-b486-72f1911f5181 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-9ebe87f6-baf5-4c01-9ce8-8a95c1e4f7d3-delete_snapshot" released by "delete_snapshot" :: held 2.917s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-quobyte-6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Deleting offline snapshot 6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d of volume 23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] snapshot_file for this snap is: volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[03103009-6438-4ba4-b34e-c7e136ba4027]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:32 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d Apr 25 02:14:32 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:33 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" returned: 0 in 0.726s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23740829-227d-4e98-9b36-9d00965021d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:33 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7025c9d6-cbbb-4001-a1fb-65149b2bdd47]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:33 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 Apr 25 02:14:33 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:34 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5" returned: 0 in 0.669s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:34 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d Apr 25 02:14:34 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:35 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" returned: 0 in 0.758s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:35 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d Apr 25 02:14:35 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:35 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5.6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" returned: 0 in 0.657s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d" released by "_delete_snapshot" :: held 2.966s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" released by "delete_snapshot" :: held 2.993s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:35 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Created reservations ['f433b3ba-d762-4469-a87e-a1f8dd6495d3', '56d2b3af-99f9-44fa-ac5e-5009797cd252', 'faf12101-0039-40a3-a185-2330da975ef8', '2fe088fe-5abc-47cf-90a9-5b5e841f32b6'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:35 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Delete snapshot completed successfully. Apr 25 02:14:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7b9d5ce5-6cb7-4cae-836d-ce371b0a68c1 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-6a293603-309b-4ec7-a1b0-bdaf1ceb2d8d-delete_snapshot" released by "delete_snapshot" :: held 3.209s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-23740829-227d-4e98-9b36-9d00965021d5-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-23740829-227d-4e98-9b36-9d00965021d5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:36 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceab4f4-87df-4ce5-b4d7-dfecd884fd92]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:36 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 Apr 25 02:14:36 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:36 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5" returned: 0 in 0.659s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:36 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5 Apr 25 02:14:36 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:37 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-23740829-227d-4e98-9b36-9d00965021d5" returned: 0 in 0.562s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-quobyte-23740829-227d-4e98-9b36-9d00965021d5" released by "delete_volume" :: held 1.285s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:37 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Created reservations ['2d0cb5ad-3409-4858-a4d1-0c231ba36450', '85c13d41-a314-494c-b859-e4825c1f6b6e', '87227779-9e34-4158-93d8-3379c7097b6c', '5e11cc1f-9686-460e-86ec-ebcfdfec60b6'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:14:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:37 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:37 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:37 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:14:37 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:38 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.656s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:14:38 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Deleted volume successfully. Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4c95e323-8bd8-4a2a-92b6-c5059bbd5ce6 tempest-VolumesSnapshotListTestJSON-585330423 None] Lock "cinder-23740829-227d-4e98-9b36-9d00965021d5-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Flow 'volume_create_manager' (676d69ae-9d06-4584-b60f-457de13ef136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac98bc8-3ee4-4e37-8d81-b957c002fafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac98bc8-3ee4-4e37-8d81-b957c002fafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-324391754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c589eaae-e52d-484c-b3a6-3d710d03f950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651a8e2137464c139241329eaf76d865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:39Z,use_quota=True,user_id='7aaf42fe29734b768071c78114b0a282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350b261d-2c71-4041-90c2-a0fad2b20a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350b261d-2c71-4041-90c2-a0fad2b20a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88e988b-75ff-4873-bb16-7fe2e8cfa1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88e988b-75ff-4873-bb16-7fe2e8cfa1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c589eaae-e52d-484c-b3a6-3d710d03f950', 'volume_name': 'volume-c589eaae-e52d-484c-b3a6-3d710d03f950', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18188f87-1eae-4236-8cfe-6cba9521f723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18188f87-1eae-4236-8cfe-6cba9521f723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fefbccc3-e11e-465d-8554-68454b2a5593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:38 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Volume c589eaae-e52d-484c-b3a6-3d710d03f950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c589eaae-e52d-484c-b3a6-3d710d03f950', 'volume_size': 1} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-324391754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c589eaae-e52d-484c-b3a6-3d710d03f950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651a8e2137464c139241329eaf76d865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:39Z,use_quota=True,user_id='7aaf42fe29734b768071c78114b0a282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Creating volume c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:14:38 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:14:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:38 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 1073741824 Apr 25 02:14:38 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:39 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 1073741824" returned: 0 in 0.721s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:39 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 Apr 25 02:14:39 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:40 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950" returned: 0 in 0.478s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:14:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fefbccc3-e11e-465d-8554-68454b2a5593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c589eaae-e52d-484c-b3a6-3d710d03f950', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea4f802-c15c-4831-a813-ec8b504d1251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:40 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Volume volume-c589eaae-e52d-484c-b3a6-3d710d03f950 (c589eaae-e52d-484c-b3a6-3d710d03f950): created successfully Apr 25 02:14:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea4f802-c15c-4831-a813-ec8b504d1251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:40 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Flow 'volume_create_manager' (676d69ae-9d06-4584-b60f-457de13ef136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:40 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bf0c86b1-d017-43b3-90fa-34a374c9b3c7 tempest-SnapshotDependencyTests-268226047 None] Created volume successfully. Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (d6b9e865-68de-4b91-9ae1-305e94155546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d045b93-18fd-41b3-9bb2-75cfa2e140e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d045b93-18fd-41b3-9bb2-75cfa2e140e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1649659722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88b6703-d556-4baa-8ebc-12723a267e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:41Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae740570-2956-46fb-91d8-19ad8515e42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae740570-2956-46fb-91d8-19ad8515e42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3a5097-01c7-43d0-beb6-f9f5aae49c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3a5097-01c7-43d0-beb6-f9f5aae49c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88b6703-d556-4baa-8ebc-12723a267e02', 'volume_name': 'volume-b88b6703-d556-4baa-8ebc-12723a267e02', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c7da44-a32c-402a-975f-13af4a29a4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c7da44-a32c-402a-975f-13af4a29a4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e16c86-943b-4c72-8d45-8dddb3ef5c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:41 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume b88b6703-d556-4baa-8ebc-12723a267e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88b6703-d556-4baa-8ebc-12723a267e02', 'volume_size': 1} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1649659722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88b6703-d556-4baa-8ebc-12723a267e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:41Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Creating volume b88b6703-d556-4baa-8ebc-12723a267e02 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:14:41 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:41 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 1073741824 Apr 25 02:14:41 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:41 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 1073741824" returned: 0 in 0.668s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:42 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 Apr 25 02:14:42 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:42 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02" returned: 0 in 0.454s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.142s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e16c86-943b-4c72-8d45-8dddb3ef5c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88b6703-d556-4baa-8ebc-12723a267e02', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9865be0e-f0b7-4290-94d1-1dec4483811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Creating offline snapshot d1723484-02e4-403d-adf9-3a92fe9317c8 of volume c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:14:42 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume volume-b88b6703-d556-4baa-8ebc-12723a267e02 (b88b6703-d556-4baa-8ebc-12723a267e02): created successfully Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9865be0e-f0b7-4290-94d1-1dec4483811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (d6b9e865-68de-4b91-9ae1-305e94155546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[918dc446-fa3f-4b50-8f46-515482da614e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:42 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d5507f12-508d-40d7-9a48-d9b7552bad11 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created volume successfully. Apr 25 02:14:42 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 Apr 25 02:14:42 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:43 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950" returned: 0 in 0.557s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:43 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 1G Apr 25 02:14:43 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 1G" returned: 0 in 0.667s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c589eaae-e52d-484c-b3a6-3d710d03f950 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:43 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:43 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c589eaae-e52d-484c-b3a6-3d710d03f950 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 Apr 25 02:14:43 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:44 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c589eaae-e52d-484c-b3a6-3d710d03f950 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8" returned: 0 in 0.469s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:44 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 is being set with open permissions: ugo+rw Apr 25 02:14:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:44 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 Apr 25 02:14:44 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:44 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8" returned: 0 in 0.505s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:44 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.info Apr 25 02:14:44 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:45 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.info" returned: 0 in 0.469s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:45 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.info is being set with open permissions: ugo+rw Apr 25 02:14:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:45 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.info Apr 25 02:14:45 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:45 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.info" returned: 0 in 0.431s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.213s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.146s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Creating offline snapshot 17f4c91e-b004-4d5a-b8b0-32c927362a78 of volume b88b6703-d556-4baa-8ebc-12723a267e02 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:14:45 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb3fb49-c202-4187-bbb2-e4ae32aad349]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:45 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-edd1985a-112b-4d33-a966-2777237650c4 tempest-SnapshotDependencyTests-268226047 None] Create snapshot completed successfully Apr 25 02:14:45 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 Apr 25 02:14:45 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:46 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02" returned: 0 in 0.532s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:46 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 1G Apr 25 02:14:46 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:47 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Flow 'volume_create_manager' (5f33e4c8-f233-4bbe-9f84-c80431d3a359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae54673-7c59-44a5-996c-1716a95b2917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 1G" returned: 0 in 0.951s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88b6703-d556-4baa-8ebc-12723a267e02 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae54673-7c59-44a5-996c-1716a95b2917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05264290-e017-4049-b7f4-aadef8348358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651a8e2137464c139241329eaf76d865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1723484-02e4-403d-adf9-3a92fe9317c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:47Z,use_quota=True,user_id='7aaf42fe29734b768071c78114b0a282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16819ed0-e6ac-463f-a590-5ebdc6bd68e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16819ed0-e6ac-463f-a590-5ebdc6bd68e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcbd446-be81-467f-9b28-abcd79d56f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcbd446-be81-467f-9b28-abcd79d56f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05264290-e017-4049-b7f4-aadef8348358', 'volume_name': 'volume-05264290-e017-4049-b7f4-aadef8348358', 'volume_size': 1, 'snapshot_id': 'd1723484-02e4-403d-adf9-3a92fe9317c8'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:47 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88b6703-d556-4baa-8ebc-12723a267e02 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 Apr 25 02:14:47 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd757ee-c4b4-4d52-985f-0a3759618edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd757ee-c4b4-4d52-985f-0a3759618edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18ca46c-f447-4ed0-a9ce-0250e42237d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:47 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Volume 05264290-e017-4049-b7f4-aadef8348358: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05264290-e017-4049-b7f4-aadef8348358', 'volume_size': 1, 'snapshot_id': 'd1723484-02e4-403d-adf9-3a92fe9317c8'} Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:47 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b88b6703-d556-4baa-8ebc-12723a267e02 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78" returned: 0 in 0.667s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:47 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 is being set with open permissions: ugo+rw Apr 25 02:14:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:47 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 Apr 25 02:14:47 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:48 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78" returned: 0 in 0.480s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:48 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.info Apr 25 02:14:48 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:48 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.info" returned: 0 in 0.513s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:48 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.info is being set with open permissions: ugo+rw Apr 25 02:14:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:48 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.info Apr 25 02:14:48 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:49 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.info" returned: 0 in 0.473s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.725s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.105s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "cinder-quobyte-d1723484-02e4-403d-adf9-3a92fe9317c8-05264290-e017-4049-b7f4-aadef8348358" by "_create_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-d1723484-02e4-403d-adf9-3a92fe9317c8-05264290-e017-4049-b7f4-aadef8348358" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Creating volume 05264290-e017-4049-b7f4-aadef8348358 from snapshot d1723484-02e4-403d-adf9-3a92fe9317c8 {{(pid=81927) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "cinder-quobyte-05264290-e017-4049-b7f4-aadef8348358" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:49 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e1ae8b42-22ad-4626-ad06-c75946245857 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Create snapshot completed successfully Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-05264290-e017-4049-b7f4-aadef8348358" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] snapshot: d1723484-02e4-403d-adf9-3a92fe9317c8, volume: 05264290-e017-4049-b7f4-aadef8348358, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67dd346-a422-490c-ace3-addbabbf8289]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:49 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 Apr 25 02:14:49 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (920f358d-4024-41d0-b9f0-f95a11ecfdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce92e3d2-f002-4a47-8f3d-7b04f7efc363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8" returned: 0 in 0.803s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce92e3d2-f002-4a47-8f3d-7b04f7efc363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1448850344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae615f2-6e5d-4204-aab3-c75d8b9b2b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:50Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0526d28-b330-420c-9a81-e7911ae6a3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0526d28-b330-420c-9a81-e7911ae6a3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c71546-881a-49ef-b40e-43806c5a9b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3c71546-881a-49ef-b40e-43806c5a9b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ae615f2-6e5d-4204-aab3-c75d8b9b2b29', 'volume_name': 'volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68f2fc6-269d-401a-830d-abccd19ad79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68f2fc6-269d-401a-830d-abccd19ad79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9d364a-0da9-4285-aadc-00e8ac4b4ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume 7ae615f2-6e5d-4204-aab3-c75d8b9b2b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29', 'volume_size': 1} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c589eaae-e52d-484c-b3a6-3d710d03f950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f337d1-6a1e-4aa4-bbf6-7f267c6a54f0]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (cb45732c-0ce0-42b0-a321-5f62dff51a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae00f24-f464-419e-99b5-93a2f9038e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae00f24-f464-419e-99b5-93a2f9038e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1723493427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:50Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f4ac5b-fb76-454f-9a1a-8e371b134489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f4ac5b-fb76-454f-9a1a-8e371b134489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8328b3-3b9e-44eb-a389-5b80c6f0b741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8328b3-3b9e-44eb-a389-5b80c6f0b741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a5bc19-c97a-428d-8fbf-b9159d4b3c2c', 'volume_name': 'volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff85e94f-6836-479b-adc6-08db86bbacca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff85e94f-6836-479b-adc6-08db86bbacca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0249cf-b849-4961-8a6c-a082db0b6ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Volume d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c', 'volume_size': 1} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:50 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 Apr 25 02:14:50 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (b189355f-5913-4a4d-956a-aa658daadd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fdc95d-474c-4278-8f21-364de8e9e2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fdc95d-474c-4278-8f21-364de8e9e2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630833938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29462701-f4e6-4a6a-a0c9-affd71b0e94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:51Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df0d3f3-fa10-4af6-bbfd-ae87edd9f8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df0d3f3-fa10-4af6-bbfd-ae87edd9f8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adc3f7a-9e23-465b-8e5a-711cb68bec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adc3f7a-9e23-465b-8e5a-711cb68bec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29462701-f4e6-4a6a-a0c9-affd71b0e94c', 'volume_name': 'volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932712cc-1609-4406-86a1-95c18ce34a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (932712cc-1609-4406-86a1-95c18ce34a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b92170-a111-42df-9cd3-f09a9fc9a9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume 29462701-f4e6-4a6a-a0c9-affd71b0e94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c', 'volume_size': 1} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (00e156af-85ad-4f0b-a135-6c85b1c901ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407595fe-3b4e-46b8-98d8-2badb4e45803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:50 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407595fe-3b4e-46b8-98d8-2badb4e45803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1759583581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:51Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f931bb-7552-4c3b-a48c-4ab2d2647bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f931bb-7552-4c3b-a48c-4ab2d2647bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e501a122-882b-4be7-b90c-748427a4e4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e501a122-882b-4be7-b90c-748427a4e4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b', 'volume_name': 'volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1338138a-218f-428a-8acb-a1f81a54c907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1338138a-218f-428a-8acb-a1f81a54c907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ce8a3f-2736-43c2-85f1-a8d1e5ef038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume 15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b', 'volume_size': 1} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:51 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950" returned: 0 in 0.752s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:51 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 Apr 25 02:14:51 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (10a726ec-069c-49eb-8524-0157dacd5519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fba9e9-a1a7-4404-9aba-ef3ce2c7a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fba9e9-a1a7-4404-9aba-ef3ce2c7a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783621523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:51Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59411b2-a3a6-438b-8100-095325ebf89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b59411b2-a3a6-438b-8100-095325ebf89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1594e63-c012-44da-91a8-d007f1f74161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1594e63-c012-44da-91a8-d007f1f74161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f', 'volume_name': 'volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d31321d-eb1d-4443-b5c8-1f88ce983a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d31321d-eb1d-4443-b5c8-1f88ce983a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4d0cee-9149-4f61-96a5-4f6c9cfd26c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f', 'volume_size': 1} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (02517ad1-e6a8-4c9f-93bf-9c9ff4917c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8263c78b-52bb-4d7f-89d1-91492b77efed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8263c78b-52bb-4d7f-89d1-91492b77efed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1948371394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b0199a-a35f-4589-9175-9afc3ce17fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:52Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd65cc12-8e65-4ed5-9f02-1d7f124b4bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd65cc12-8e65-4ed5-9f02-1d7f124b4bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c20ba60-75a6-4542-a1b4-7beaaa043ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c20ba60-75a6-4542-a1b4-7beaaa043ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b0199a-a35f-4589-9175-9afc3ce17fe8', 'volume_name': 'volume-20b0199a-a35f-4589-9175-9afc3ce17fe8', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9f7fcf-9f0b-43aa-8a26-0e0650c05084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9f7fcf-9f0b-43aa-8a26-0e0650c05084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d647fd-3ed0-408b-b6db-70be87848cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume 20b0199a-a35f-4589-9175-9afc3ce17fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b0199a-a35f-4589-9175-9afc3ce17fe8', 'volume_size': 1} Apr 25 02:14:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:57 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358" returned: 0 in 6.081s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:57 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f32000f-0161-46fe-8981-bbf5ba7c4d0f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:57 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 Apr 25 02:14:57 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:57 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950" returned: 0 in 0.657s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:57 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:14:57 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Converted 1024.00 MB image at 168.36 MB/s Apr 25 02:14:57 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 is being set with open permissions: ugo+rw Apr 25 02:14:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:57 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 Apr 25 02:14:57 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:58 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358" returned: 0 in 0.429s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-05264290-e017-4049-b7f4-aadef8348358" released by "_copy_volume_from_snapshot" :: held 8.908s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-d1723484-02e4-403d-adf9-3a92fe9317c8-05264290-e017-4049-b7f4-aadef8348358" released by "_create_volume_from_snapshot" :: held 8.960s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.014s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1448850344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae615f2-6e5d-4204-aab3-c75d8b9b2b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:50Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Creating volume 7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:14:58 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:58 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 1073741824 Apr 25 02:14:58 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18ca46c-f447-4ed0-a9ce-0250e42237d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05264290-e017-4049-b7f4-aadef8348358', 'volume_size': 1, 'snapshot_id': 'd1723484-02e4-403d-adf9-3a92fe9317c8'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751add78-f7f9-4da3-adab-f05cab406916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:58 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Volume volume-05264290-e017-4049-b7f4-aadef8348358 (05264290-e017-4049-b7f4-aadef8348358): created successfully Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751add78-f7f9-4da3-adab-f05cab406916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Flow 'volume_create_manager' (5f33e4c8-f233-4bbe-9f84-c80431d3a359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:58 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-20861b71-4ffb-42d9-b1e9-1ea5f156b9b4 tempest-SnapshotDependencyTests-268226047 None] Created volume successfully. Apr 25 02:14:59 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 1073741824" returned: 0 in 0.661s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:59 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 Apr 25 02:14:59 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "cinder-d1723484-02e4-403d-adf9-3a92fe9317c8-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-d1723484-02e4-403d-adf9-3a92fe9317c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "cinder-quobyte-c589eaae-e52d-484c-b3a6-3d710d03f950" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-c589eaae-e52d-484c-b3a6-3d710d03f950" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "cinder-quobyte-d1723484-02e4-403d-adf9-3a92fe9317c8" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-d1723484-02e4-403d-adf9-3a92fe9317c8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Deleting offline snapshot d1723484-02e4-403d-adf9-3a92fe9317c8 of volume c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] snapshot_file for this snap is: volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bec6e77-7855-4571-8dfc-27ff8d39c538]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:59 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29" returned: 0 in 0.538s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:59 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 Apr 25 02:14:59 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.095s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1723493427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:50Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Creating volume d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:14:59 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9d364a-0da9-4285-aadc-00e8ac4b4ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c7b039-d123-451e-b1ba-5738ab4b7e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:14:59 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c 1073741824 Apr 25 02:14:59 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:14:59 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 (7ae615f2-6e5d-4204-aab3-c75d8b9b2b29): created successfully Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c7b039-d123-451e-b1ba-5738ab4b7e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:14:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (920f358d-4024-41d0-b9f0-f95a11ecfdfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:14:59 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5ef1cf07-13c1-476c-a517-45e485d89297 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created volume successfully. Apr 25 02:15:00 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8" returned: 0 in 0.617s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c589eaae-e52d-484c-b3a6-3d710d03f950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6448e11-e6bf-41ed-8b16-239986b77ee6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:00 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 Apr 25 02:15:00 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:00 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c 1073741824" returned: 0 in 0.707s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:00 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c Apr 25 02:15:00 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:00 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950" returned: 0 in 0.561s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:00 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 Apr 25 02:15:00 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:00 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c" returned: 0 in 0.447s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.145s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-630833938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29462701-f4e6-4a6a-a0c9-affd71b0e94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:51Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Creating volume 29462701-f4e6-4a6a-a0c9-affd71b0e94c {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:00 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0249cf-b849-4961-8a6c-a082db0b6ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:00 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c 1073741824 Apr 25 02:15:00 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32bd421-5376-47de-8258-574fd0b5df67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:00 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Volume volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c (d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c): created successfully Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e32bd421-5376-47de-8258-574fd0b5df67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (cb45732c-0ce0-42b0-a321-5f62dff51a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:00 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f0bddc47-774c-4ac1-b538-861a2be39c20 tempest-VolumesActionsTest-343799157 None] Created volume successfully. Apr 25 02:15:01 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8" returned: 0 in 0.561s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:01 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8 Apr 25 02:15:01 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:01 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c 1073741824" returned: 0 in 0.689s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:01 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c Apr 25 02:15:01 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-abdd0e6f-98bc-4c5b-b444-cca1f8c50cc7 tempest-VolumesActionsTest-343799157 None] Acquiring lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c" by "attach_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-abdd0e6f-98bc-4c5b-b444-cca1f8c50cc7 tempest-VolumesActionsTest-343799157 None] Lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c" acquired by "attach_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-abdd0e6f-98bc-4c5b-b444-cca1f8c50cc7 tempest-VolumesActionsTest-343799157 None] Attaching volume d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c to instance 48140ed5-4ae1-4f8d-9255-a35a157f5e24 at mountpoint /dev/vdb on host None. Apr 25 02:15:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-abdd0e6f-98bc-4c5b-b444-cca1f8c50cc7 tempest-VolumesActionsTest-343799157 None] Attach volume completed successfully. Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-abdd0e6f-98bc-4c5b-b444-cca1f8c50cc7 tempest-VolumesActionsTest-343799157 None] Lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c" released by "attach_volume" :: held 0.093s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:01 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950.d1723484-02e4-403d-adf9-3a92fe9317c8" returned: 0 in 0.516s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-d1723484-02e4-403d-adf9-3a92fe9317c8" released by "_delete_snapshot" :: held 2.383s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-c589eaae-e52d-484c-b3a6-3d710d03f950" released by "delete_snapshot" :: held 2.419s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Created reservations ['cbdd8c67-3a85-4f9f-9693-5631a53f0eba', 'cc59af19-c3c8-41f5-a275-d04aba891498', '736a9cf1-1e33-46b5-8761-e9fbdadd4349', '0b4d1f9f-d2b2-452d-9b0f-0c8872905de6'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Delete snapshot completed successfully. Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a8c3adf1-aa59-46b3-94fe-f3d9f642bdff tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-d1723484-02e4-403d-adf9-3a92fe9317c8-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:02 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c" returned: 0 in 0.495s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.084s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1759583581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:51Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Creating volume 15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:02 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b92170-a111-42df-9cd3-f09a9fc9a9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:02 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b 1073741824 Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50004f4-d30b-4c27-9866-4714fde8e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:02 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:02 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c (29462701-f4e6-4a6a-a0c9-affd71b0e94c): created successfully Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50004f4-d30b-4c27-9866-4714fde8e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (b189355f-5913-4a4d-956a-aa658daadd52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-925f22bd-3f64-4fbb-9e5e-56c3c4b62200 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created volume successfully. Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "cinder-c589eaae-e52d-484c-b3a6-3d710d03f950-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-c589eaae-e52d-484c-b3a6-3d710d03f950-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "cinder-quobyte-c589eaae-e52d-484c-b3a6-3d710d03f950" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-c589eaae-e52d-484c-b3a6-3d710d03f950" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5603cca-7c20-4c71-a820-96fa790934cf]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:02 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 Apr 25 02:15:02 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:02 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b 1073741824" returned: 0 in 0.749s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-21315f2e-3e6e-499d-832a-ed77123244d6 tempest-VolumesActionsTest-209144965 None] Terminate volume connection completed successfully. Apr 25 02:15:02 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b Apr 25 02:15:02 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:03 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950" returned: 0 in 0.512s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:03 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950 Apr 25 02:15:03 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:03 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b" returned: 0 in 0.443s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.997s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1783621523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:51Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Creating volume c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:03 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ce8a3f-2736-43c2-85f1-a8d1e5ef038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59457611-da9f-4ba3-8c23-671b8bff2fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-21315f2e-3e6e-499d-832a-ed77123244d6 tempest-VolumesActionsTest-209144965 None] Acquiring lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c-detach_volume" by "detach_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:03 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f 1073741824 Apr 25 02:15:03 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:03 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b (15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b): created successfully Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59457611-da9f-4ba3-8c23-671b8bff2fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (00e156af-85ad-4f0b-a135-6c85b1c901ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-21315f2e-3e6e-499d-832a-ed77123244d6 tempest-VolumesActionsTest-209144965 None] Lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-21315f2e-3e6e-499d-832a-ed77123244d6 tempest-VolumesActionsTest-209144965 None] Detaching volume d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c from instance 48140ed5-4ae1-4f8d-9255-a35a157f5e24. Apr 25 02:15:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-fc3cb449-d8af-4b38-8656-a8f3dd0b31cd tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created volume successfully. Apr 25 02:15:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-21315f2e-3e6e-499d-832a-ed77123244d6 tempest-VolumesActionsTest-209144965 None] Detach volume completed successfully. Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-21315f2e-3e6e-499d-832a-ed77123244d6 tempest-VolumesActionsTest-209144965 None] Lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:03 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c589eaae-e52d-484c-b3a6-3d710d03f950" returned: 0 in 0.470s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-c589eaae-e52d-484c-b3a6-3d710d03f950" released by "delete_volume" :: held 1.043s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Created reservations ['68a3fdc8-b5c1-4cf0-953e-9fc539eee708', 'de88fcb8-0110-4541-bab7-dcffc4d3e584', '1bb4bcbe-d26c-49cc-bb09-0cea42ed1e52', '6a62380a-15c9-45a5-8631-2dbfb6eae7e8'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:03 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:03 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:04 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5f343ad-d512-4fed-bef7-427d19160844 tempest-VolumesActionsTest-343799157 None] Acquiring lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c-detach_volume" by "detach_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f 1073741824" returned: 0 in 0.736s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5f343ad-d512-4fed-bef7-427d19160844 tempest-VolumesActionsTest-343799157 None] Lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c5f343ad-d512-4fed-bef7-427d19160844 tempest-VolumesActionsTest-343799157 None] Volume detach called, but volume not attached. Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "cinder-05264290-e017-4049-b7f4-aadef8348358-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-05264290-e017-4049-b7f4-aadef8348358-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5f343ad-d512-4fed-bef7-427d19160844 tempest-VolumesActionsTest-343799157 None] Lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:04 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f Apr 25 02:15:04 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "cinder-quobyte-05264290-e017-4049-b7f4-aadef8348358" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-05264290-e017-4049-b7f4-aadef8348358" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b00896d-206b-43e0-bad5-4b17ce6b0a49]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:04 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 Apr 25 02:15:04 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:04 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.499s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Deleted volume successfully. Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-847b780d-44b7-46cd-a233-43d7ca6beaa9 tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-c589eaae-e52d-484c-b3a6-3d710d03f950-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:04 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f" returned: 0 in 0.504s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1948371394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b0199a-a35f-4589-9175-9afc3ce17fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00c69ebf1fc4487cb35bce73c0ad130e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:14:52Z,use_quota=True,user_id='03357398f8d640ecaec8f66cd99bdc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Creating volume 20b0199a-a35f-4589-9175-9afc3ce17fe8 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:04 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:04 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 1073741824 Apr 25 02:15:04 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4d0cee-9149-4f61-96a5-4f6c9cfd26c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a77a274-36a9-4fc3-8446-510581e590ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:04 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f (c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f): created successfully Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a77a274-36a9-4fc3-8446-510581e590ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (10a726ec-069c-49eb-8524-0157dacd5519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-10e6a8fd-bd75-40fb-9672-6c98a49f4ed6 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created volume successfully. Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Acquiring lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Acquiring lock "cinder-quobyte-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Lock "cinder-quobyte-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c" acquired by "delete_volume" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[af15571b-8788-418c-8c33-d350193c366a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:04 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358" returned: 0 in 0.654s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:04 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358 Apr 25 02:15:04 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:05 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c Apr 25 02:15:05 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:05 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 1073741824" returned: 0 in 0.672s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:05 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 Apr 25 02:15:05 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:05 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-05264290-e017-4049-b7f4-aadef8348358" returned: 0 in 0.511s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-quobyte-05264290-e017-4049-b7f4-aadef8348358" released by "delete_volume" :: held 1.203s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:05 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c" returned: 0 in 0.566s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:05 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c Apr 25 02:15:05 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Created reservations ['10aad5af-7b72-4c2c-a151-8d8e9ed9fb6d', 'bd75ec15-fdaf-4afb-a4fd-802e0f6aa3ab', '1d17ad10-be10-4443-a468-4fbacfdcd8f7', '39327a2b-c750-46e5-8800-5f6dba3deefb'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:05 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:05 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:05 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8" returned: 0 in 0.518s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:05 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d647fd-3ed0-408b-b6db-70be87848cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b0199a-a35f-4589-9175-9afc3ce17fe8', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4759da4-fd2c-40c1-b83e-a4288cd83abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c" returned: 0 in 0.488s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Lock "cinder-quobyte-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c" released by "delete_volume" :: held 1.106s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:06 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Volume volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 (20b0199a-a35f-4589-9175-9afc3ce17fe8): created successfully Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4759da4-fd2c-40c1-b83e-a4288cd83abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Flow 'volume_create_manager' (02517ad1-e6a8-4c9f-93bf-9c9ff4917c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:06 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1025693e-58e8-4db3-b2a0-bda8d72b2a3d tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created volume successfully. Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Created reservations ['1840ccc4-daae-4165-a6a5-52202fd9216d', '65395577-1424-47e0-a773-7a36e6687ba6', '30aa0db4-8130-419b-b43f-49472aa0fc52', 'c8ffc931-dad0-4caf-a36e-482e9955509e'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:06 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.515s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:06 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Deleted volume successfully. Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e98f08dc-a1dc-46bf-a796-ddd67224d10d tempest-SnapshotDependencyTests-268226047 None] Lock "cinder-05264290-e017-4049-b7f4-aadef8348358-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:06 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:06 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:06 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.448s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:06 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Deleted volume successfully. Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d0450e39-72e2-4342-a92e-d3e57ce73ce0 tempest-VolumesActionsTest-343799157 None] Lock "cinder-d6a5bc19-c97a-428d-8fbf-b9159d4b3c2c-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-20b0199a-a35f-4589-9175-9afc3ce17fe8-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-20b0199a-a35f-4589-9175-9afc3ce17fe8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-quobyte-20b0199a-a35f-4589-9175-9afc3ce17fe8" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-20b0199a-a35f-4589-9175-9afc3ce17fe8" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:07 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd9aab7-8a3e-4100-8964-1203ce54602d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:07 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 Apr 25 02:15:07 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:07 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8" returned: 0 in 0.663s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:07 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8 Apr 25 02:15:07 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:08 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-20b0199a-a35f-4589-9175-9afc3ce17fe8" returned: 0 in 0.605s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-20b0199a-a35f-4589-9175-9afc3ce17fe8" released by "delete_volume" :: held 1.316s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:08 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created reservations ['272771af-300d-4873-9187-e889e73b9844', 'cd937908-ba8e-4290-97f3-e6db783d7af6', 'beddb6fd-31f9-409b-a98c-afb4e4a5685e', '3045fa4e-dcb8-44bc-9034-ae647b55c17e'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:08 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:08 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:09 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.688s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:09 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:09 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:09 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Deleted volume successfully. Apr 25 02:15:09 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:09 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-34bfb7de-ac95-4a1b-b374-15fa57545b71 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-20b0199a-a35f-4589-9175-9afc3ce17fe8-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:09 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-quobyte-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:09 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:09 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bd5c33-3410-421b-b083-34d658b157b7]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:09 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f Apr 25 02:15:09 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:10 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f" returned: 0 in 0.758s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:10 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f Apr 25 02:15:10 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:10 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f" returned: 0 in 0.563s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f" released by "delete_volume" :: held 1.384s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created reservations ['0f07efd0-4250-4ddf-8c65-f6135e45814c', 'cac25b20-644f-43b3-88f4-028df67c0f42', 'de44befb-7446-4a22-962a-a0f47922aff6', 'd6673a7f-97a2-469a-b000-5e9a30f7d921'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:10 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:10 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:11 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:11 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:11 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.532s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:11 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Deleted volume successfully. Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-98fde232-a745-439a-a036-1d6debe21b50 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-c1e4f122-a7c6-412c-af8d-ba0b3a4f2b5f-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-quobyte-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:11 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.566s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b" acquired by "delete_volume" :: waited 0.033s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[df97d057-4bf2-4f64-860f-ff291ee7642b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:11 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b Apr 25 02:15:11 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:12 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b" returned: 0 in 0.603s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:12 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b Apr 25 02:15:12 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:12 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b" returned: 0 in 0.511s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b" released by "delete_volume" :: held 1.158s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created reservations ['0673de12-74ec-4278-8e77-69601c6efa1f', 'cb29bf5e-f04d-4aa4-9988-c25847ec3206', '5b619b7b-9d93-4914-8fee-ca54948a4fbe', '31106d06-1a16-4f45-a708-20d74bc0c1a1'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:12 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:13 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:13 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.486s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:13 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:13 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Deleted volume successfully. Apr 25 02:15:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3af2f547-be38-4305-88d0-3cde04e5c198 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-15e1e764-fbd3-447c-91ba-cd6a6ba6bb7b-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-29462701-f4e6-4a6a-a0c9-affd71b0e94c-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-29462701-f4e6-4a6a-a0c9-affd71b0e94c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-quobyte-29462701-f4e6-4a6a-a0c9-affd71b0e94c" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-29462701-f4e6-4a6a-a0c9-affd71b0e94c" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:13 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a754767-ce73-4ed1-9c34-58f67837d01c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:14 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c Apr 25 02:15:14 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:14 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c" returned: 0 in 0.610s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:14 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c Apr 25 02:15:14 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (5bfdf0e7-bc4a-46d9-a527-fd454f5f9fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:15 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4be3344-91de-4eee-bead-322c9ef55c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-29462701-f4e6-4a6a-a0c9-affd71b0e94c" returned: 0 in 0.573s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4be3344-91de-4eee-bead-322c9ef55c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1293105507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57f11b0-4eab-461e-923f-687eb6490fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:15Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea1c5d0-704e-452b-bf59-e7c701b18d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea1c5d0-704e-452b-bf59-e7c701b18d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30912cf-a822-47d3-b71b-984b7aad8c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30912cf-a822-47d3-b71b-984b7aad8c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f57f11b0-4eab-461e-923f-687eb6490fe1', 'volume_name': 'volume-f57f11b0-4eab-461e-923f-687eb6490fe1', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d293df-ddfb-4ba9-bbe5-7c4735a7189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d293df-ddfb-4ba9-bbe5-7c4735a7189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e018a47-81c5-48fd-8927-e77e7e88336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:15 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Volume f57f11b0-4eab-461e-923f-687eb6490fe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f57f11b0-4eab-461e-923f-687eb6490fe1', 'volume_size': 1} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1293105507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f57f11b0-4eab-461e-923f-687eb6490fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:15Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Creating volume f57f11b0-4eab-461e-923f-687eb6490fe1 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:15 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-29462701-f4e6-4a6a-a0c9-affd71b0e94c" released by "delete_volume" :: held 1.292s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:15 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1 1073741824 Apr 25 02:15:15 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created reservations ['45258872-2ff7-49d3-b5ba-9a9100956b07', 'e9711608-b973-4f1a-8a40-b399d9af6fce', '854c3fe2-73df-4d6b-947e-975673e410e9', 'ced2c5e2-995f-4e8f-95a1-be5278165ec1'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:15 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:15 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:15 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1 1073741824" returned: 0 in 0.738s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:15 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.601s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:16 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1 Apr 25 02:15:16 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:16 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Deleted volume successfully. Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9297914f-f14a-4b7b-bc98-de584410e060 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-29462701-f4e6-4a6a-a0c9-affd71b0e94c-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-quobyte-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e983084-cd88-4b89-b334-17cce8a0ad72]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:16 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 Apr 25 02:15:16 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:16 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1" returned: 0 in 0.546s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e018a47-81c5-48fd-8927-e77e7e88336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f57f11b0-4eab-461e-923f-687eb6490fe1', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3507772-90c0-4ee3-8c4d-07a39d7bca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:16 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Volume volume-f57f11b0-4eab-461e-923f-687eb6490fe1 (f57f11b0-4eab-461e-923f-687eb6490fe1): created successfully Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3507772-90c0-4ee3-8c4d-07a39d7bca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (5bfdf0e7-bc4a-46d9-a527-fd454f5f9fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:16 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-63772425-d45d-430c-b93d-c5d347ab91ff tempest-VolumesActionsTest-343799157 None] Created volume successfully. Apr 25 02:15:16 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29" returned: 0 in 0.579s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:16 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29 Apr 25 02:15:16 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:17 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29" returned: 0 in 0.438s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29" released by "delete_volume" :: held 1.061s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created reservations ['118dbc11-186f-43fe-86ca-ce90b258920a', 'a1807448-4c9a-47f9-a199-6ca7fd2298cb', 'cb47bd1c-6a96-4dc9-9d05-c7223ea271f4', 'd6996ed6-b7bc-40ea-b438-fd3c5f4b0b4c'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Acquiring lock "cinder-f57f11b0-4eab-461e-923f-687eb6490fe1-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:17 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:17 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Lock "cinder-f57f11b0-4eab-461e-923f-687eb6490fe1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Acquiring lock "cinder-quobyte-f57f11b0-4eab-461e-923f-687eb6490fe1" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Lock "cinder-quobyte-f57f11b0-4eab-461e-923f-687eb6490fe1" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc1232a-6da1-4601-9449-c3350e56489f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:17 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1 Apr 25 02:15:17 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:17 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.482s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:17 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Deleted volume successfully. Apr 25 02:15:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-03c68c79-7744-4772-870b-9ff5a823bdb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-7ae615f2-6e5d-4204-aab3-c75d8b9b2b29-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:18 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1" returned: 0 in 0.536s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:18 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1 Apr 25 02:15:18 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-17f4c91e-b004-4d5a-b8b0-32c927362a78-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-17f4c91e-b004-4d5a-b8b0-32c927362a78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-quobyte-b88b6703-d556-4baa-8ebc-12723a267e02" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-b88b6703-d556-4baa-8ebc-12723a267e02" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-quobyte-17f4c91e-b004-4d5a-b8b0-32c927362a78" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-17f4c91e-b004-4d5a-b8b0-32c927362a78" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Deleting offline snapshot 17f4c91e-b004-4d5a-b8b0-32c927362a78 of volume b88b6703-d556-4baa-8ebc-12723a267e02 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] snapshot_file for this snap is: volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d684ef-df90-4955-afbe-af03606d287d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:18 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 Apr 25 02:15:18 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:18 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f57f11b0-4eab-461e-923f-687eb6490fe1" returned: 0 in 0.466s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Lock "cinder-quobyte-f57f11b0-4eab-461e-923f-687eb6490fe1" released by "delete_volume" :: held 1.041s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Created reservations ['3f1ca35d-27f4-4fa2-ae71-d1c6189350e2', 'd8f1ccb7-8d70-4082-bfba-d157d3b756df', '8858ac4e-5dd4-40a4-a5c2-852d0efefa39', 'ad504771-0f0e-4523-9122-9524ab08f23b'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:18 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:18 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:18 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78" returned: 0 in 0.561s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b88b6703-d556-4baa-8ebc-12723a267e02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:15:19 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[3054a1ae-90bf-495f-a469-5bbc9b2b74dc]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:19 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 Apr 25 02:15:19 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:19 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.452s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:19 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:19 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Deleted volume successfully. Apr 25 02:15:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ed03ea3d-d4b3-4ef0-8976-c93b6ac3ebd5 tempest-VolumesActionsTest-209144965 None] Lock "cinder-f57f11b0-4eab-461e-923f-687eb6490fe1-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:19 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02" returned: 0 in 0.526s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:19 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 Apr 25 02:15:19 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:19 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (ee0f85de-6e35-4959-bd12-b50e2fb2332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5fcc824-d83f-4602-9766-0b05fcb6162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5fcc824-d83f-4602-9766-0b05fcb6162e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2008667772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101e84c9-26ae-485b-b7ad-2e32625eb163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:20Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06f05b4-4b27-4db4-a4dd-20134ce882ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06f05b4-4b27-4db4-a4dd-20134ce882ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d339843-3941-45df-91bc-284686fd4716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d339843-3941-45df-91bc-284686fd4716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101e84c9-26ae-485b-b7ad-2e32625eb163', 'volume_name': 'volume-101e84c9-26ae-485b-b7ad-2e32625eb163', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd711b7-6732-496a-94f1-c2a34415854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd711b7-6732-496a-94f1-c2a34415854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054586d5-95a6-4912-bdbb-7c3668a8b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:20 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Volume 101e84c9-26ae-485b-b7ad-2e32625eb163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101e84c9-26ae-485b-b7ad-2e32625eb163', 'volume_size': 1} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2008667772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101e84c9-26ae-485b-b7ad-2e32625eb163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:20Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Creating volume 101e84c9-26ae-485b-b7ad-2e32625eb163 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:20 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:20 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163 1073741824 Apr 25 02:15:20 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:20 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78" returned: 0 in 0.575s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:20 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78 Apr 25 02:15:20 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:20 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02.17f4c91e-b004-4d5a-b8b0-32c927362a78" returned: 0 in 0.465s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-17f4c91e-b004-4d5a-b8b0-32c927362a78" released by "_delete_snapshot" :: held 2.222s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-b88b6703-d556-4baa-8ebc-12723a267e02" released by "delete_snapshot" :: held 2.242s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:20 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163 1073741824" returned: 0 in 0.607s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created reservations ['111f80a9-5672-4535-bd76-500fcf68abac', 'caba2012-d3bf-4ac1-a42b-af05127128c6', 'c422fa2e-e602-4e40-966f-8297a653d7ca', 'fc071832-37b5-4164-a76a-e9e673848c83'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:20 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163 Apr 25 02:15:20 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:20 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Delete snapshot completed successfully. Apr 25 02:15:20 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-93a5846d-2bf4-4d18-8c7d-aa7b530b4930 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-17f4c91e-b004-4d5a-b8b0-32c927362a78-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:21 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163" returned: 0 in 0.437s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054586d5-95a6-4912-bdbb-7c3668a8b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101e84c9-26ae-485b-b7ad-2e32625eb163', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b381df79-2a88-4091-bc2d-9099962e9a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:21 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Volume volume-101e84c9-26ae-485b-b7ad-2e32625eb163 (101e84c9-26ae-485b-b7ad-2e32625eb163): created successfully Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b381df79-2a88-4091-bc2d-9099962e9a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (ee0f85de-6e35-4959-bd12-b50e2fb2332f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-40df9b37-73d7-4a23-848f-eeea60a2a2a1 tempest-VolumesActionsTest-343799157 None] Created volume successfully. Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-b88b6703-d556-4baa-8ebc-12723a267e02-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-b88b6703-d556-4baa-8ebc-12723a267e02-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "cinder-quobyte-b88b6703-d556-4baa-8ebc-12723a267e02" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-b88b6703-d556-4baa-8ebc-12723a267e02" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdfe545-740f-4ab4-83f7-a8472a1c478d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:21 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 Apr 25 02:15:21 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:22 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02" returned: 0 in 0.518s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:22 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02 Apr 25 02:15:22 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Acquiring lock "cinder-101e84c9-26ae-485b-b7ad-2e32625eb163-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Lock "cinder-101e84c9-26ae-485b-b7ad-2e32625eb163-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Acquiring lock "cinder-quobyte-101e84c9-26ae-485b-b7ad-2e32625eb163" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Lock "cinder-quobyte-101e84c9-26ae-485b-b7ad-2e32625eb163" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968f77c-18fb-4ef5-b29a-b9f368ab306c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:22 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163 Apr 25 02:15:22 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:22 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b88b6703-d556-4baa-8ebc-12723a267e02" returned: 0 in 0.466s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-quobyte-b88b6703-d556-4baa-8ebc-12723a267e02" released by "delete_volume" :: held 1.049s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Created reservations ['c9d1f9d6-6b43-41cf-8f1d-116c6021bc88', 'eab8e0d1-d927-498e-87c4-61d21a2b04e1', '9ebf4bc9-e825-4f9f-bff4-c86c522873d4', '0ecf15ac-8ff3-477f-8e33-2f350ccc1936'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:22 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:22 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:22 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163" returned: 0 in 0.543s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:22 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163 Apr 25 02:15:22 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:23 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.428s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:23 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Deleted volume successfully. Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-75579ffe-27c9-4fc6-8b06-dd5bb7fa7fb7 tempest-CreateVolumesFromSnapshotTest-1327043544 None] Lock "cinder-b88b6703-d556-4baa-8ebc-12723a267e02-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:23 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-101e84c9-26ae-485b-b7ad-2e32625eb163" returned: 0 in 0.458s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Lock "cinder-quobyte-101e84c9-26ae-485b-b7ad-2e32625eb163" released by "delete_volume" :: held 1.037s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Created reservations ['3dc65e7f-9154-4b02-ab1d-4149360facfb', 'a920eda6-1ae6-495e-80a8-83c0dc4b2237', '81c0e20f-c165-4980-8ee6-40e8ef8a9dfa', '0956bf69-bda1-4cd5-a3b2-25539761b3bc'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:23 devstack sudo[89640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:23 devstack sudo[89640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:23 devstack sudo[89640]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.463s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:23 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Deleted volume successfully. Apr 25 02:15:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b64ba80f-be82-4048-bb68-3aa562341ed2 tempest-VolumesActionsTest-209144965 None] Lock "cinder-101e84c9-26ae-485b-b7ad-2e32625eb163-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (597300ba-ebbe-4153-9b4d-c7af66e2af9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbd5fb3-61e9-4815-885d-e0c205697ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbd5fb3-61e9-4815-885d-e0c205697ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415766141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbef81ba-d910-4c23-8cf9-5de31553c05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:25Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427d149e-c7ed-4178-907c-5746aca26e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427d149e-c7ed-4178-907c-5746aca26e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4e1934-3b2f-42dd-a46f-5a661b0e9597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca4e1934-3b2f-42dd-a46f-5a661b0e9597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbef81ba-d910-4c23-8cf9-5de31553c05c', 'volume_name': 'volume-cbef81ba-d910-4c23-8cf9-5de31553c05c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf9e3ef-effb-4170-abf0-9502741fe7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf9e3ef-effb-4170-abf0-9502741fe7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbba6fe4-a47e-40d9-a5b7-a5137b8a758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:24 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Volume cbef81ba-d910-4c23-8cf9-5de31553c05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbef81ba-d910-4c23-8cf9-5de31553c05c', 'volume_size': 1} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1415766141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbef81ba-d910-4c23-8cf9-5de31553c05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:25Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Creating volume cbef81ba-d910-4c23-8cf9-5de31553c05c {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:24 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:24 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c 1073741824 Apr 25 02:15:24 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:25 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c 1073741824" returned: 0 in 0.675s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:25 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c Apr 25 02:15:25 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:26 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c" returned: 0 in 0.497s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbba6fe4-a47e-40d9-a5b7-a5137b8a758d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbef81ba-d910-4c23-8cf9-5de31553c05c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff71b1a-7590-4475-9419-156988963533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:26 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Volume volume-cbef81ba-d910-4c23-8cf9-5de31553c05c (cbef81ba-d910-4c23-8cf9-5de31553c05c): created successfully Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff71b1a-7590-4475-9419-156988963533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (597300ba-ebbe-4153-9b4d-c7af66e2af9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:26 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-88b223f7-aa30-4fa2-a6c8-24adeda9ed38 tempest-VolumesActionsTest-343799157 None] Created volume successfully. Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (683a4949-6f75-4cb6-b857-17bfce051dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4c5650-cb5c-4a7b-9160-c01e9f384d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4c5650-cb5c-4a7b-9160-c01e9f384d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-961162038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3317a304-6737-4c05-948e-d320d641d516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:26Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d19668-4b07-48fd-b5df-869f8efb2fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d19668-4b07-48fd-b5df-869f8efb2fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1968249-e260-4364-b0af-59641b57dd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1968249-e260-4364-b0af-59641b57dd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3317a304-6737-4c05-948e-d320d641d516', 'volume_name': 'volume-3317a304-6737-4c05-948e-d320d641d516', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44301bdc-1448-46ec-b137-93a0735ea675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44301bdc-1448-46ec-b137-93a0735ea675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa0bceb-2ed5-46a9-866f-2374e7069129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:26 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume 3317a304-6737-4c05-948e-d320d641d516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3317a304-6737-4c05-948e-d320d641d516', 'volume_size': 1} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-961162038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3317a304-6737-4c05-948e-d320d641d516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:26Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Creating volume 3317a304-6737-4c05-948e-d320d641d516 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:26 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:26 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516 1073741824 Apr 25 02:15:26 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:27 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516 1073741824" returned: 0 in 0.610s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:27 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516 Apr 25 02:15:27 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Acquiring lock "cinder-cbef81ba-d910-4c23-8cf9-5de31553c05c-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Lock "cinder-cbef81ba-d910-4c23-8cf9-5de31553c05c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Acquiring lock "cinder-quobyte-cbef81ba-d910-4c23-8cf9-5de31553c05c" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Lock "cinder-quobyte-cbef81ba-d910-4c23-8cf9-5de31553c05c" acquired by "delete_volume" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dbe384-a640-4f0d-a10a-e9ffa110920a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:27 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c Apr 25 02:15:27 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:27 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516" returned: 0 in 0.468s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa0bceb-2ed5-46a9-866f-2374e7069129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3317a304-6737-4c05-948e-d320d641d516', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a0309f-8618-49cc-b260-8fc0e4c038a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:27 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume volume-3317a304-6737-4c05-948e-d320d641d516 (3317a304-6737-4c05-948e-d320d641d516): created successfully Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a0309f-8618-49cc-b260-8fc0e4c038a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (683a4949-6f75-4cb6-b857-17bfce051dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:27 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9094359e-2790-4931-a298-7179d24d4010 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created volume successfully. Apr 25 02:15:27 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c" returned: 0 in 0.529s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:27 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c Apr 25 02:15:27 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:28 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cbef81ba-d910-4c23-8cf9-5de31553c05c" returned: 0 in 0.415s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Lock "cinder-quobyte-cbef81ba-d910-4c23-8cf9-5de31553c05c" released by "delete_volume" :: held 0.984s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:INSERT=52,cinder:UPDATE=158,cinder:SELECT=124,cinder:DELETE=14 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=132,cinder:UPDATE=180,cinder:INSERT=32,cinder:DELETE=13 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Created reservations ['6ef7a03b-ef28-46d1-9ec9-5f4eb6d57a2b', '012653af-6657-4562-9dd4-4a5ceaad06bd', '68ea61a2-9459-4488-8987-7d64384eecc1', 'e448d996-64a2-4343-8e2a-f20ae045fbd0'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:28 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:28 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:28 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (9523b200-2635-45be-8e28-1d13520e535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa1dafd-ae12-4b49-b990-fd7a22b13710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.496s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Deleted volume successfully. Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa1dafd-ae12-4b49-b990-fd7a22b13710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400587582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3e2604-ca20-4e29-839a-4ff988482051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:29Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b357f6a6-271e-47b5-af16-0e24e3d8bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b357f6a6-271e-47b5-af16-0e24e3d8bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a21a47b-580e-4925-848a-a6fcdf2eb7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a21a47b-580e-4925-848a-a6fcdf2eb7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3e2604-ca20-4e29-839a-4ff988482051', 'volume_name': 'volume-9e3e2604-ca20-4e29-839a-4ff988482051', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42939d8d-9adc-4502-b0a8-f3d267c8a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42939d8d-9adc-4502-b0a8-f3d267c8a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d5f013-926b-426e-9898-f76dfc56b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:28 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume 9e3e2604-ca20-4e29-839a-4ff988482051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3e2604-ca20-4e29-839a-4ff988482051', 'volume_size': 1} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400587582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3e2604-ca20-4e29-839a-4ff988482051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:29Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Creating volume 9e3e2604-ca20-4e29-839a-4ff988482051 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:28 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:28 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051 1073741824 Apr 25 02:15:28 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-df8463a0-775f-4b27-bc40-ef25d948d0cb tempest-VolumesActionsTest-209144965 None] Lock "cinder-cbef81ba-d910-4c23-8cf9-5de31553c05c-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (7c904f99-ad40-4f2d-87ba-c84a73ef3163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f4031b-7932-44bd-9b23-11be622dbff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f4031b-7932-44bd-9b23-11be622dbff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579715591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b143a44-9f20-425a-84ee-e8f1611eb1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:29Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc470ac-463d-4c4e-b13f-64e1e816adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc470ac-463d-4c4e-b13f-64e1e816adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c7b8f8-6a93-44d4-bd5c-b7504c7fe11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c7b8f8-6a93-44d4-bd5c-b7504c7fe11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b143a44-9f20-425a-84ee-e8f1611eb1c9', 'volume_name': 'volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e21611-8edf-4ea4-8f80-95f3610faf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e21611-8edf-4ea4-8f80-95f3610faf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b765b-b97d-4c3e-be60-6f1c78aad993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume 0b143a44-9f20-425a-84ee-e8f1611eb1c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9', 'volume_size': 1} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (d2d8b27e-dfad-487f-b843-c80d8b9b348b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b957bf94-84eb-4648-8a29-ba2d75bbe4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b957bf94-84eb-4648-8a29-ba2d75bbe4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-638847760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e47a5a2-feb0-475c-8c49-1d30ca0a3de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:29Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ec511e-494d-4872-8ae9-52c16f2b948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ec511e-494d-4872-8ae9-52c16f2b948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2690f0a8-20e3-4f31-a9d1-e0a8515c8df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2690f0a8-20e3-4f31-a9d1-e0a8515c8df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e47a5a2-feb0-475c-8c49-1d30ca0a3de5', 'volume_name': 'volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d98885-0ff3-4da6-ad7a-d7360738d3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d98885-0ff3-4da6-ad7a-d7360738d3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f733f361-191a-4982-881d-e08f0c7d0836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume 8e47a5a2-feb0-475c-8c49-1d30ca0a3de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5', 'volume_size': 1} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:29 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051 1073741824" returned: 0 in 0.760s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (4b8e429d-4d8a-4934-8049-d8cd695e0d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:29 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051 Apr 25 02:15:29 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b794b857-9c6f-4cfa-8743-29d582d31af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b794b857-9c6f-4cfa-8743-29d582d31af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-142455648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f53800-7d39-472c-b836-7e4b50f0e97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:30Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042272a7-7fa4-47f0-90c9-9ece22bc0a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042272a7-7fa4-47f0-90c9-9ece22bc0a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c7848b-8c12-4916-a3a3-a73869ef02cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c7848b-8c12-4916-a3a3-a73869ef02cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f53800-7d39-472c-b836-7e4b50f0e97d', 'volume_name': 'volume-09f53800-7d39-472c-b836-7e4b50f0e97d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8a63bc-011c-4027-92c7-db6877565eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8a63bc-011c-4027-92c7-db6877565eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1e2df1-acaf-4681-982e-54f1080d55c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume 09f53800-7d39-472c-b836-7e4b50f0e97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f53800-7d39-472c-b836-7e4b50f0e97d', 'volume_size': 1} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (ada1366f-5abb-4665-89e9-6066d1f4ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab91e3c-b330-4790-ba5f-d3299a569b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab91e3c-b330-4790-ba5f-d3299a569b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213500007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd99ce5-917f-4e9d-97ef-19dc3a3d2984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:30Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551fb9ea-4180-418d-a7dd-c6879f6139e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551fb9ea-4180-418d-a7dd-c6879f6139e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b9997a-3653-4fad-9ce8-e2090a8a8dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b9997a-3653-4fad-9ce8-e2090a8a8dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd99ce5-917f-4e9d-97ef-19dc3a3d2984', 'volume_name': 'volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5adbdcb-d3c8-4c18-bc3a-c1cf4f2c7897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5adbdcb-d3c8-4c18-bc3a-c1cf4f2c7897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3abcb1-53b7-4c35-b1ce-a7a259abb1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:30 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Volume ecd99ce5-917f-4e9d-97ef-19dc3a3d2984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984', 'volume_size': 1} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (08445e54-d11d-4029-b157-2aa6d468c566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a067fd34-f1fd-477d-81c6-f37e65d443b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a067fd34-f1fd-477d-81c6-f37e65d443b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821350058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e718722-165d-43ef-9dbd-425f8e52569f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:30Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159b3cc7-3dd2-4f26-abdc-97eb86428356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159b3cc7-3dd2-4f26-abdc-97eb86428356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c40799-ae6a-4fc1-bf42-3cf480ce3947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c40799-ae6a-4fc1-bf42-3cf480ce3947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e718722-165d-43ef-9dbd-425f8e52569f', 'volume_name': 'volume-3e718722-165d-43ef-9dbd-425f8e52569f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9aed20-f322-40f4-81c3-15037a7399ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b9aed20-f322-40f4-81c3-15037a7399ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39519c81-adcd-4d04-a1eb-ff6efb500db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:30 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume 3e718722-165d-43ef-9dbd-425f8e52569f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e718722-165d-43ef-9dbd-425f8e52569f', 'volume_size': 1} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:30 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051" returned: 0 in 0.531s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579715591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b143a44-9f20-425a-84ee-e8f1611eb1c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:29Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Creating volume 0b143a44-9f20-425a-84ee-e8f1611eb1c9 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:30 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d5f013-926b-426e-9898-f76dfc56b284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3e2604-ca20-4e29-839a-4ff988482051', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:30 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 1073741824 Apr 25 02:15:30 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7238b00-2f32-4d4e-8f75-de0cf0a71dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:30 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume volume-9e3e2604-ca20-4e29-839a-4ff988482051 (9e3e2604-ca20-4e29-839a-4ff988482051): created successfully Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7238b00-2f32-4d4e-8f75-de0cf0a71dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (9523b200-2635-45be-8e28-1d13520e535e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:30 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-7bc2023e-0c07-4f4f-876f-c9c61274d384 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created volume successfully. Apr 25 02:15:30 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 1073741824" returned: 0 in 0.586s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:30 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 Apr 25 02:15:30 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:31 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9" returned: 0 in 0.453s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.856s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-638847760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e47a5a2-feb0-475c-8c49-1d30ca0a3de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:29Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Creating volume 8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:31 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565b765b-b97d-4c3e-be60-6f1c78aad993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98abffc4-2c71-49c8-89ca-7e0c5e0d7fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:31 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 1073741824 Apr 25 02:15:31 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:31 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 (0b143a44-9f20-425a-84ee-e8f1611eb1c9): created successfully Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98abffc4-2c71-49c8-89ca-7e0c5e0d7fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (7c904f99-ad40-4f2d-87ba-c84a73ef3163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bb73e227-880a-4a59-88f7-0a7527f6edeb tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created volume successfully. Apr 25 02:15:31 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 1073741824" returned: 0 in 0.633s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:32 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 Apr 25 02:15:32 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:32 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5" returned: 0 in 0.459s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.596s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-142455648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f53800-7d39-472c-b836-7e4b50f0e97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:30Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Creating volume 09f53800-7d39-472c-b836-7e4b50f0e97d {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:32 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f733f361-191a-4982-881d-e08f0c7d0836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:32 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d 1073741824 Apr 25 02:15:32 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3d1f59-f779-4c47-b33b-910d7f8300df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:32 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 (8e47a5a2-feb0-475c-8c49-1d30ca0a3de5): created successfully Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3d1f59-f779-4c47-b33b-910d7f8300df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (d2d8b27e-dfad-487f-b843-c80d8b9b348b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:32 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-312b6330-0c65-4cd1-8ea2-6633b7fc742f tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created volume successfully. Apr 25 02:15:33 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d 1073741824" returned: 0 in 0.595s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:33 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d Apr 25 02:15:33 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:33 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d" returned: 0 in 0.452s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.540s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213500007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd99ce5-917f-4e9d-97ef-19dc3a3d2984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:30Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Creating volume ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:33 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1e2df1-acaf-4681-982e-54f1080d55c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f53800-7d39-472c-b836-7e4b50f0e97d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:33 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 1073741824 Apr 25 02:15:33 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41a1eb5-d5ad-4714-b305-92c17117eeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:33 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume volume-09f53800-7d39-472c-b836-7e4b50f0e97d (09f53800-7d39-472c-b836-7e4b50f0e97d): created successfully Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41a1eb5-d5ad-4714-b305-92c17117eeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (4b8e429d-4d8a-4934-8049-d8cd695e0d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:33 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-45ac789c-8b35-4f33-9955-4a9a7fe81c30 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created volume successfully. Apr 25 02:15:34 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 1073741824" returned: 0 in 0.588s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:34 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 Apr 25 02:15:34 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:34 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984" returned: 0 in 0.427s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.503s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1821350058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e718722-165d-43ef-9dbd-425f8e52569f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02616acdfcff4d81aa225e2d5bb0afb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:30Z,use_quota=True,user_id='216ae89346ac4aacbc525928f2c9b2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Creating volume 3e718722-165d-43ef-9dbd-425f8e52569f {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:34 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:34 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f 1073741824 Apr 25 02:15:34 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3abcb1-53b7-4c35-b1ce-a7a259abb1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5c30ee-c157-4a79-b055-c8a4a851e87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:34 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Volume volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 (ecd99ce5-917f-4e9d-97ef-19dc3a3d2984): created successfully Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d5c30ee-c157-4a79-b055-c8a4a851e87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (ada1366f-5abb-4665-89e9-6066d1f4ccce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:34 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f80d8787-56cd-4271-aeab-4be5f49a3fc3 tempest-VolumesActionsTest-343799157 None] Created volume successfully. Apr 25 02:15:35 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f 1073741824" returned: 0 in 0.614s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:35 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f Apr 25 02:15:35 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Acquiring lock "cinder-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Lock "cinder-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Acquiring lock "cinder-quobyte-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Lock "cinder-quobyte-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9520045-10f0-4001-9a73-46af5ffe284e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:35 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 Apr 25 02:15:35 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:35 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f" returned: 0 in 0.446s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39519c81-adcd-4d04-a1eb-ff6efb500db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e718722-165d-43ef-9dbd-425f8e52569f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1b32a0-bd30-4466-89ce-3ec340b20080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:35 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Volume volume-3e718722-165d-43ef-9dbd-425f8e52569f (3e718722-165d-43ef-9dbd-425f8e52569f): created successfully Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca1b32a0-bd30-4466-89ce-3ec340b20080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Flow 'volume_create_manager' (08445e54-d11d-4029-b157-2aa6d468c566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:35 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-75b84fd5-9aea-42ee-a9d7-3f471d6235f7 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created volume successfully. Apr 25 02:15:35 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984" returned: 0 in 0.523s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:35 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984 Apr 25 02:15:35 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:36 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984" returned: 0 in 0.426s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Lock "cinder-quobyte-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984" released by "delete_volume" :: held 0.998s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Created reservations ['11eb49b6-8ee3-4130-b50c-ce114966df34', '668e5a52-f6bb-41f3-9b35-1d9d2b4be252', '22483ca2-6d0f-4884-970a-181ae94c8043', 'c076fdbe-f805-426b-8eeb-feaba9c96377'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:36 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:36 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-3e718722-165d-43ef-9dbd-425f8e52569f-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-3e718722-165d-43ef-9dbd-425f8e52569f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-quobyte-3e718722-165d-43ef-9dbd-425f8e52569f" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-3e718722-165d-43ef-9dbd-425f8e52569f" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[9915819b-b26b-44b2-bb19-508cc964d59d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:36 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f Apr 25 02:15:36 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:36 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.468s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:37 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Deleted volume successfully. Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b5ff9a25-0595-4f26-b3ca-2859d2ec83a9 tempest-VolumesActionsTest-209144965 None] Lock "cinder-ecd99ce5-917f-4e9d-97ef-19dc3a3d2984-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:37 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f" returned: 0 in 0.542s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:37 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f Apr 25 02:15:37 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:37 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3e718722-165d-43ef-9dbd-425f8e52569f" returned: 0 in 0.466s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-3e718722-165d-43ef-9dbd-425f8e52569f" released by "delete_volume" :: held 1.052s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created reservations ['40e60a64-3792-471c-b0a8-804b37ff99bc', '311d32aa-02c5-46c7-bf3a-30e0424bce03', 'd60cd02c-b7f7-4192-8cba-88caa9654331', 'b5de1f5b-d85c-481c-8af0-f7c1b468eea3'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:37 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:37 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (dde227b6-3a0e-42bf-bcad-2df1f4b29488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae3a97c-961e-4568-b718-e953e6adc33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae3a97c-961e-4568-b718-e953e6adc33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-385912019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6a893a-20ed-4854-b360-469c9f1b87bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:38Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8898f56-b62c-456f-8ed1-faa9540d8b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:37 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8898f56-b62c-456f-8ed1-faa9540d8b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706f56ad-ae6a-465c-b42b-00dcf5bea284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706f56ad-ae6a-465c-b42b-00dcf5bea284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6a893a-20ed-4854-b360-469c9f1b87bd', 'volume_name': 'volume-ed6a893a-20ed-4854-b360-469c9f1b87bd', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6257836e-5eee-4d0e-b79b-cc73f4b29d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6257836e-5eee-4d0e-b79b-cc73f4b29d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df0f238-7488-428c-b6b2-763b2804ce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:38 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Volume ed6a893a-20ed-4854-b360-469c9f1b87bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6a893a-20ed-4854-b360-469c9f1b87bd', 'volume_size': 1} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-385912019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6a893a-20ed-4854-b360-469c9f1b87bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f09b33184994eecb0374bafc8186b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:38Z,use_quota=True,user_id='e8482332c8d9491797a99738c7881b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Creating volume ed6a893a-20ed-4854-b360-469c9f1b87bd {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:38 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:38 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd 1073741824 Apr 25 02:15:38 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:38 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.434s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:38 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Deleted volume successfully. Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b9a26078-7630-42da-a511-6f3d57fcd9c4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-3e718722-165d-43ef-9dbd-425f8e52569f-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:38 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd 1073741824" returned: 0 in 0.618s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:38 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd Apr 25 02:15:38 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-09f53800-7d39-472c-b836-7e4b50f0e97d-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-09f53800-7d39-472c-b836-7e4b50f0e97d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-quobyte-09f53800-7d39-472c-b836-7e4b50f0e97d" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-09f53800-7d39-472c-b836-7e4b50f0e97d" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6067e145-abb5-420c-829d-c63c0d9c98fc]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:39 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d Apr 25 02:15:39 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:39 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd" returned: 0 in 0.479s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df0f238-7488-428c-b6b2-763b2804ce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6a893a-20ed-4854-b360-469c9f1b87bd', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4ea02e-8b2f-475e-9df2-551fe03a0368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:39 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Volume volume-ed6a893a-20ed-4854-b360-469c9f1b87bd (ed6a893a-20ed-4854-b360-469c9f1b87bd): created successfully Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4ea02e-8b2f-475e-9df2-551fe03a0368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Flow 'volume_create_manager' (dde227b6-3a0e-42bf-bcad-2df1f4b29488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:39 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9cf1e5a8-81f7-4b41-aa51-9a7592e90d3e tempest-VolumesActionsTest-343799157 None] Created volume successfully. Apr 25 02:15:39 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d" returned: 0 in 0.505s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:39 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d Apr 25 02:15:39 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:39 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-09f53800-7d39-472c-b836-7e4b50f0e97d" returned: 0 in 0.440s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-09f53800-7d39-472c-b836-7e4b50f0e97d" released by "delete_volume" :: held 0.995s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:39 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created reservations ['84b7011e-2fe7-4ec1-ad36-292f7b6dcb6c', '00b20a82-62a2-4e1e-b38e-61c9c490adf4', '5a38e61d-accc-41e7-a292-887dfa6a552e', 'f1b01682-2f01-4eb1-8c2a-d23506930217'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:40 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:40 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:40 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.467s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:40 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Deleted volume successfully. Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6ae551ad-2002-4446-8174-da8ac739acf4 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-09f53800-7d39-472c-b836-7e4b50f0e97d-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Acquiring lock "cinder-ed6a893a-20ed-4854-b360-469c9f1b87bd-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Lock "cinder-ed6a893a-20ed-4854-b360-469c9f1b87bd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Acquiring lock "cinder-quobyte-ed6a893a-20ed-4854-b360-469c9f1b87bd" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Lock "cinder-quobyte-ed6a893a-20ed-4854-b360-469c9f1b87bd" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b79bea-d4aa-4d77-82ec-f73575a6ae03]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:40 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd Apr 25 02:15:40 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-quobyte-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd06e4fb-7a25-4add-ae2d-0d43f152a915]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:41 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 Apr 25 02:15:41 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:41 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd" returned: 0 in 0.559s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:41 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd Apr 25 02:15:41 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:41 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5" returned: 0 in 0.540s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:41 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5 Apr 25 02:15:41 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:41 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ed6a893a-20ed-4854-b360-469c9f1b87bd" returned: 0 in 0.495s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Lock "cinder-quobyte-ed6a893a-20ed-4854-b360-469c9f1b87bd" released by "delete_volume" :: held 1.093s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Created reservations ['739ea6ce-4fb9-4961-8635-dd961f174f96', 'f8a97a2a-fe6e-4edb-b0ae-937b9a07d82f', '1b3f0c49-a5aa-4579-bedf-a6981f9f7f2b', 'b122551e-6c0c-4fdf-88c1-089d9bf5f5f6'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:41 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:41 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:42 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5" returned: 0 in 0.483s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5" released by "delete_volume" :: held 1.072s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created reservations ['0334a9c2-6430-4758-8d45-9e013cc7d819', '1e57f5f4-ce34-4f28-ae50-f272073d1c42', '4cb8504e-25d6-4c81-a6a2-d59bd8c7ce69', '5df7fb95-b997-4430-9567-9d72bbd4576c'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:42 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:42 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:42 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.448s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:42 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Deleted volume successfully. Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c143f088-ccf9-458c-b223-958cc12bc791 tempest-VolumesActionsTest-343799157 None] Lock "cinder-ed6a893a-20ed-4854-b360-469c9f1b87bd-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:42 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.451s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:42 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Deleted volume successfully. Apr 25 02:15:42 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-39e27191-6e16-4666-a0c1-3cacd36f70ce tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-8e47a5a2-feb0-475c-8c49-1d30ca0a3de5-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-0b143a44-9f20-425a-84ee-e8f1611eb1c9-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-0b143a44-9f20-425a-84ee-e8f1611eb1c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-quobyte-0b143a44-9f20-425a-84ee-e8f1611eb1c9" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:43 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-0b143a44-9f20-425a-84ee-e8f1611eb1c9" acquired by "delete_volume" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:43 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19b38de-4ddb-4266-ab2d-ebc390ce7022]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:43 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 Apr 25 02:15:43 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:43 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9" returned: 0 in 0.581s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:43 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9 Apr 25 02:15:43 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:44 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0b143a44-9f20-425a-84ee-e8f1611eb1c9" returned: 0 in 0.549s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:44 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-0b143a44-9f20-425a-84ee-e8f1611eb1c9" released by "delete_volume" :: held 1.189s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:44 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created reservations ['4341f6f0-587f-403d-9f43-666dd9e78e84', 'ecb49249-0400-41b6-ad94-1531c08c806c', '1cc70253-4e94-4908-9853-9ce5ea8f2d5b', 'b7974a00-0211-467e-91bb-6cdadb7f0dfe'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:44 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:44 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:45 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.503s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:45 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:45 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Deleted volume successfully. Apr 25 02:15:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a435691a-72da-42be-9325-e6a6a4f2a7c8 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-0b143a44-9f20-425a-84ee-e8f1611eb1c9-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-9e3e2604-ca20-4e29-839a-4ff988482051-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-9e3e2604-ca20-4e29-839a-4ff988482051-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-quobyte-9e3e2604-ca20-4e29-839a-4ff988482051" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-9e3e2604-ca20-4e29-839a-4ff988482051" acquired by "delete_volume" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:45 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb45392-c4d0-490e-9ae9-048e5255e398]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:45 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051 Apr 25 02:15:45 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:46 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051" returned: 0 in 0.580s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:46 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051 Apr 25 02:15:46 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:46 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9e3e2604-ca20-4e29-839a-4ff988482051" returned: 0 in 0.486s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-9e3e2604-ca20-4e29-839a-4ff988482051" released by "delete_volume" :: held 1.115s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created reservations ['1a5398f7-6d8c-43e0-a361-15a23d6bfdd8', '75a748fb-b999-4e57-8a9e-72403b8c460e', '072816ae-ae7f-4db2-9f18-504554712549', '9fd87334-d677-42ab-9eb4-2c3449c3bdfc'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:46 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:46 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:47 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.491s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:47 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:47 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Deleted volume successfully. Apr 25 02:15:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7c30cc8e-38da-46f7-8eef-4457fdf00b36 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-9e3e2604-ca20-4e29-839a-4ff988482051-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-3317a304-6737-4c05-948e-d320d641d516-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-3317a304-6737-4c05-948e-d320d641d516-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "cinder-quobyte-3317a304-6737-4c05-948e-d320d641d516" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-3317a304-6737-4c05-948e-d320d641d516" acquired by "delete_volume" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:47 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38b17a7-0172-426e-b1e0-d192e28c870c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:47 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516 Apr 25 02:15:47 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:48 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516" returned: 0 in 0.597s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:48 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516 Apr 25 02:15:48 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:49 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-3317a304-6737-4c05-948e-d320d641d516" returned: 0 in 0.560s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-quobyte-3317a304-6737-4c05-948e-d320d641d516" released by "delete_volume" :: held 1.206s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Created reservations ['dfa35d1e-1fd5-46da-a860-1e953c463974', '932bc389-0906-4df2-9844-ddeb1a02f858', '65ddf635-4d2e-4a37-96db-014f9cbde784', '7a30d93d-7f1f-45b9-9d95-afab29e4d01b'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:49 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:15:49 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:49 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.468s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:15:49 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Deleted volume successfully. Apr 25 02:15:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8935eb2f-02f4-4850-b528-9c4d9a3d2751 tempest-CreateVolumesFromSourceVolumeTest-140362275 None] Lock "cinder-3317a304-6737-4c05-948e-d320d641d516-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Flow 'volume_create_manager' (a35a1b76-0e12-40f3-8e0c-601ddc2698b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac941a7-ad9f-44a3-838d-2fb645fce845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac941a7-ad9f-44a3-838d-2fb645fce845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-646351016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ec3403fffec4561a7e3de4eafc52e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:53Z,use_quota=True,user_id='f904fc75ea5847e18d6a6f4d014059c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce7924c-1899-4698-8023-045ae45ad056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce7924c-1899-4698-8023-045ae45ad056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9531d889-b55b-4ce5-8a4e-966d92955ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9531d889-b55b-4ce5-8a4e-966d92955ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd224fe8f-4d80-4dcb-9cf1-1712e61b5dd8', 'volume_name': 'volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a327f354-6e88-4f99-9f0c-f2d06a84feda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a327f354-6e88-4f99-9f0c-f2d06a84feda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0a4760-4f18-4fd7-812f-0364e2fed7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Volume d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8', 'volume_size': 1} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-646351016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ec3403fffec4561a7e3de4eafc52e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:53Z,use_quota=True,user_id='f904fc75ea5847e18d6a6f4d014059c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Creating volume d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:52 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:52 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 1073741824 Apr 25 02:15:52 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:53 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 1073741824" returned: 0 in 0.689s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:53 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 Apr 25 02:15:53 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:53 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" returned: 0 in 0.508s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:53 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0a4760-4f18-4fd7-812f-0364e2fed7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28dbb85-926b-461e-a6c3-02025abd02e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:54 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Volume volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 (d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8): created successfully Apr 25 02:15:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28dbb85-926b-461e-a6c3-02025abd02e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Flow 'volume_create_manager' (a35a1b76-0e12-40f3-8e0c-601ddc2698b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:54 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-02c60914-c69b-47c1-843c-9ed29aad7cb2 tempest-VolumeDependencyTests-1970114903 None] Created volume successfully. Apr 25 02:15:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Creating offline snapshot 8459f56d-a0c3-4b46-84ba-f96b6d365020 of volume d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:15:55 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aba781-81fb-4b76-8102-9ba72a774b49]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:55 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 Apr 25 02:15:55 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:55 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" returned: 0 in 0.688s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:55 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 1G Apr 25 02:15:55 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:56 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 1G" returned: 0 in 0.673s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:56 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 Apr 25 02:15:56 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:56 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020" returned: 0 in 0.546s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:56 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 is being set with open permissions: ugo+rw Apr 25 02:15:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:56 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 Apr 25 02:15:56 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:57 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020" returned: 0 in 0.479s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:57 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.info Apr 25 02:15:57 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Flow 'volume_create_manager' (092d9158-377a-49c3-88d4-07d31b4df078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929bd3d7-ccc5-4c23-8bc0-87990215b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929bd3d7-ccc5-4c23-8bc0-87990215b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-790579018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e6d518-7053-42ba-852a-3423ffd46846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57d1868621ff4525ae4ddabafaa60977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:58Z,use_quota=True,user_id='41ea83ddcb1543e5bd9b01c7db8687a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cd3141-1678-4261-9b7e-414e7663a328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cd3141-1678-4261-9b7e-414e7663a328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e32941-f322-4ce9-9ed2-de7d8ab16acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e32941-f322-4ce9-9ed2-de7d8ab16acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e6d518-7053-42ba-852a-3423ffd46846', 'volume_name': 'volume-f1e6d518-7053-42ba-852a-3423ffd46846', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed41b657-196b-4da3-93c9-0196d2e8adec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed41b657-196b-4da3-93c9-0196d2e8adec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6afd94b-df0c-4748-9ffe-672553c177ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:57 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Volume f1e6d518-7053-42ba-852a-3423ffd46846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e6d518-7053-42ba-852a-3423ffd46846', 'volume_size': 1} Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:57 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.info" returned: 0 in 0.503s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:57 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.info is being set with open permissions: ugo+rw Apr 25 02:15:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:57 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.info Apr 25 02:15:57 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:58 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.info" returned: 0 in 0.416s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.403s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-790579018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e6d518-7053-42ba-852a-3423ffd46846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57d1868621ff4525ae4ddabafaa60977',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:58Z,use_quota=True,user_id='41ea83ddcb1543e5bd9b01c7db8687a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Creating volume f1e6d518-7053-42ba-852a-3423ffd46846 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:58 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:58 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846 1073741824 Apr 25 02:15:58 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:58 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4c9db4a7-3b5b-4040-b1df-c9c443f9a193 tempest-VolumeDependencyTests-1970114903 None] Create snapshot completed successfully Apr 25 02:15:58 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846 1073741824" returned: 0 in 0.613s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:59 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846 Apr 25 02:15:59 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:59 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846" returned: 0 in 0.479s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6afd94b-df0c-4748-9ffe-672553c177ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e6d518-7053-42ba-852a-3423ffd46846', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e974d9e4-aecb-40b1-9cb8-de6cbaa8fd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:59 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Volume volume-f1e6d518-7053-42ba-852a-3423ffd46846 (f1e6d518-7053-42ba-852a-3423ffd46846): created successfully Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e974d9e4-aecb-40b1-9cb8-de6cbaa8fd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Flow 'volume_create_manager' (092d9158-377a-49c3-88d4-07d31b4df078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Flow 'volume_create_manager' (0056c214-3a71-4b54-a3d6-2ed9d75a3f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99af07d-071f-4b30-a13f-ab5e4f360f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99af07d-071f-4b30-a13f-ab5e4f360f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-369949660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac24728a-ade5-43c7-8364-feec0efe33de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ec3403fffec4561a7e3de4eafc52e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8459f56d-a0c3-4b46-84ba-f96b6d365020,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:15:59Z,use_quota=True,user_id='f904fc75ea5847e18d6a6f4d014059c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2512af9c-4307-4070-97f6-6df0ce916d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2512af9c-4307-4070-97f6-6df0ce916d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69396625-7415-4fbd-ad77-834df4d52568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69396625-7415-4fbd-ad77-834df4d52568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac24728a-ade5-43c7-8364-feec0efe33de', 'volume_name': 'volume-ac24728a-ade5-43c7-8364-feec0efe33de', 'volume_size': 1, 'snapshot_id': '8459f56d-a0c3-4b46-84ba-f96b6d365020'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d4a2f3-b99e-4407-86e7-8dca5575b2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d4a2f3-b99e-4407-86e7-8dca5575b2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ddb013-ed46-4079-b9bc-07459679736e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:15:59 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Volume ac24728a-ade5-43c7-8364-feec0efe33de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac24728a-ade5-43c7-8364-feec0efe33de', 'volume_size': 1, 'snapshot_id': '8459f56d-a0c3-4b46-84ba-f96b6d365020'} Apr 25 02:15:59 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e70cdb9e-6769-4af0-ac73-2ab91f3c0511 tempest-AbsoluteLimitsTests-1873959559 None] Created volume successfully. Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-8459f56d-a0c3-4b46-84ba-f96b6d365020-ac24728a-ade5-43c7-8364-feec0efe33de" by "_create_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-8459f56d-a0c3-4b46-84ba-f96b6d365020-ac24728a-ade5-43c7-8364-feec0efe33de" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Creating volume ac24728a-ade5-43c7-8364-feec0efe33de from snapshot 8459f56d-a0c3-4b46-84ba-f96b6d365020 {{(pid=81927) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-ac24728a-ade5-43c7-8364-feec0efe33de" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-ac24728a-ade5-43c7-8364-feec0efe33de" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] snapshot: 8459f56d-a0c3-4b46-84ba-f96b6d365020, volume: ac24728a-ade5-43c7-8364-feec0efe33de, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[691cb664-2433-44a1-a3fe-b3fe3dad24fe]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:15:59 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 Apr 25 02:15:59 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Acquiring lock "cinder-f1e6d518-7053-42ba-852a-3423ffd46846-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:15:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Lock "cinder-f1e6d518-7053-42ba-852a-3423ffd46846-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Acquiring lock "cinder-quobyte-f1e6d518-7053-42ba-852a-3423ffd46846" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Lock "cinder-quobyte-f1e6d518-7053-42ba-852a-3423ffd46846" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b95a0b-0dac-458f-9b34-f2c13fecc6d3]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:00 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846 Apr 25 02:16:00 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:00 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020" returned: 0 in 0.581s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[493a00a9-c37f-4a09-b9c5-0a2d325cbb0a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:00 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 Apr 25 02:16:00 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:00 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846" returned: 0 in 0.567s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:00 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846 Apr 25 02:16:00 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:00 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" returned: 0 in 0.548s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:16:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:00 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de Apr 25 02:16:00 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:01 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f1e6d518-7053-42ba-852a-3423ffd46846" returned: 0 in 0.469s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Lock "cinder-quobyte-f1e6d518-7053-42ba-852a-3423ffd46846" released by "delete_volume" :: held 1.073s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Created reservations ['75ad6b3c-505a-410e-9382-621dbf1258aa', '48a37043-8702-437b-84e7-f528807054c3', '728ff2a0-e52f-4af5-955d-7bf1f47aea5a', '04f74213-980a-47d8-ab2b-08b4a64c7b62'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:01 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:01 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:01 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.666s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Deleted volume successfully. Apr 25 02:16:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7187c815-e404-43c1-aed5-dcbce5aae3b3 tempest-AbsoluteLimitsTests-1873959559 None] Lock "cinder-f1e6d518-7053-42ba-852a-3423ffd46846-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:06 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de" returned: 0 in 5.322s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:06 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b218d4a-08cf-4d95-9ac5-cc09a3048797]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:06 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 Apr 25 02:16:06 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:06 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" returned: 0 in 0.716s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:06 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:16:06 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Converted 1024.00 MB image at 192.37 MB/s Apr 25 02:16:06 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de is being set with open permissions: ugo+rw Apr 25 02:16:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:06 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de Apr 25 02:16:06 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:07 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de" returned: 0 in 0.525s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-ac24728a-ade5-43c7-8364-feec0efe33de" released by "_copy_volume_from_snapshot" :: held 7.792s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-8459f56d-a0c3-4b46-84ba-f96b6d365020-ac24728a-ade5-43c7-8364-feec0efe33de" released by "_create_volume_from_snapshot" :: held 7.822s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.843s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ddb013-ed46-4079-b9bc-07459679736e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac24728a-ade5-43c7-8364-feec0efe33de', 'volume_size': 1, 'snapshot_id': '8459f56d-a0c3-4b46-84ba-f96b6d365020'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2511fd-53c0-40e9-8eb6-31741a2ac567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:07 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Volume volume-ac24728a-ade5-43c7-8364-feec0efe33de (ac24728a-ade5-43c7-8364-feec0efe33de): created successfully Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2511fd-53c0-40e9-8eb6-31741a2ac567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Flow 'volume_create_manager' (0056c214-3a71-4b54-a3d6-2ed9d75a3f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:07 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-76ab5cec-8be4-4e90-ac80-76da42cfa963 tempest-VolumeDependencyTests-1970114903 None] Created volume successfully. Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Flow 'volume_create_manager' (2da4c831-f410-46cc-bd8a-fb0fe95b8328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00598dd2-883e-41df-b39f-e70af010388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00598dd2-883e-41df-b39f-e70af010388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1396286342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a81b32-af5d-4e17-b0cf-6fbfb3e17106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6c1c9f6b54dc095e5d15e81d311bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:08Z,use_quota=True,user_id='352c4fc8fe45463fb8cca356e25d86ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22771144-d1f8-491d-8f9e-237455694c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22771144-d1f8-491d-8f9e-237455694c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43f5f4e-3869-4209-a27c-679c6620c336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43f5f4e-3869-4209-a27c-679c6620c336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a81b32-af5d-4e17-b0cf-6fbfb3e17106', 'volume_name': 'volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8140aa0a-2006-4c7b-9ced-d9a6c32517cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8140aa0a-2006-4c7b-9ced-d9a6c32517cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa34608e-617d-4ac4-b4aa-9efeea42578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:07 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Volume e1a81b32-af5d-4e17-b0cf-6fbfb3e17106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106', 'volume_size': 1} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1396286342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a81b32-af5d-4e17-b0cf-6fbfb3e17106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d6c1c9f6b54dc095e5d15e81d311bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:08Z,use_quota=True,user_id='352c4fc8fe45463fb8cca356e25d86ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Creating volume e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:16:07 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:16:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:07 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 1073741824 Apr 25 02:16:07 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-8459f56d-a0c3-4b46-84ba-f96b6d365020-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-8459f56d-a0c3-4b46-84ba-f96b6d365020-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-8459f56d-a0c3-4b46-84ba-f96b6d365020" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-8459f56d-a0c3-4b46-84ba-f96b6d365020" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Deleting offline snapshot 8459f56d-a0c3-4b46-84ba-f96b6d365020 of volume d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] snapshot_file for this snap is: volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5cded1-1bfb-4383-9927-b35c22d39111]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:08 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 Apr 25 02:16:08 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:08 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 1073741824" returned: 0 in 0.660s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:08 devstack sudo[89952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 Apr 25 02:16:08 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:09 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020" returned: 0 in 0.562s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9122ffc-991c-4d16-b2cb-8706f5e7c505]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:09 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106" returned: 0 in 0.517s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:09 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 Apr 25 02:16:09 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa34608e-617d-4ac4-b4aa-9efeea42578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c630013-4809-42dd-91d3-aac95156d80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:09 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Volume volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 (e1a81b32-af5d-4e17-b0cf-6fbfb3e17106): created successfully Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c630013-4809-42dd-91d3-aac95156d80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Flow 'volume_create_manager' (2da4c831-f410-46cc-bd8a-fb0fe95b8328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:09 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a46ebe58-2f9a-4bdb-ba03-ef798c89d891 tempest-VolumesMetadataTest-1790708471 None] Created volume successfully. Apr 25 02:16:09 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" returned: 0 in 0.539s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:09 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 Apr 25 02:16:09 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:10 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020" returned: 0 in 0.567s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:10 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020 Apr 25 02:16:10 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:10 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8.8459f56d-a0c3-4b46-84ba-f96b6d365020" returned: 0 in 0.447s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-8459f56d-a0c3-4b46-84ba-f96b6d365020" released by "_delete_snapshot" :: held 2.226s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" released by "delete_snapshot" :: held 2.254s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Acquiring lock "cinder-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Lock "cinder-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Acquiring lock "cinder-quobyte-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Lock "cinder-quobyte-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Created reservations ['84e22c4b-f574-408f-b900-60b5e6332b28', 'ed707aea-e748-4c9a-b7eb-64a871de248d', '53e05043-9167-4811-ba27-aa837727c4c5', '2976fb4a-648b-4fce-b504-506e796db4ec'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c8ede6-11f4-4b98-866e-ec7974bf2480]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:10 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Delete snapshot completed successfully. Apr 25 02:16:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88c8f63e-1830-4025-85ce-1a683f70bd0f tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-8459f56d-a0c3-4b46-84ba-f96b6d365020-delete_snapshot" released by "delete_snapshot" :: held 2.470s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:10 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 Apr 25 02:16:10 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:11 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:11 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:11 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106" returned: 0 in 0.518s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:11 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106 Apr 25 02:16:11 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:11 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.461s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb7e6b5-9b55-4f7b-b2e9-ded7382a75d8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:11 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 Apr 25 02:16:11 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:11 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106" returned: 0 in 0.519s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Lock "cinder-quobyte-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106" released by "delete_volume" :: held 1.079s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Created reservations ['fcd37dd8-b9a7-48af-a42c-c0e5c3768f14', 'a2b40539-a139-4cfc-9b67-ec6d421dd0fc', 'e82cdd1b-f676-49ad-8b24-f2dd00080265', 'f00a1b0d-46bb-4f9a-a6f6-f9752ce9e244'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:12 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:12 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:12 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" returned: 0 in 0.523s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:12 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8 Apr 25 02:16:12 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:12 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.441s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:12 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Deleted volume successfully. Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-4f1c01b6-992d-4536-a973-ebc7c7fe3ff1 tempest-VolumesMetadataTest-1790708471 None] Lock "cinder-e1a81b32-af5d-4e17-b0cf-6fbfb3e17106-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:12 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" returned: 0 in 0.459s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8" released by "delete_volume" :: held 1.035s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Created reservations ['ad10786e-2782-48e0-82fd-9eb28756c0af', '8a60d6c7-748c-41de-a940-63de61bd2360', '168d4262-cc47-4d0b-9f8a-1c729670996f', '6bfe8e2c-7b49-49fd-b469-79df4b6b9136'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:12 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:12 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:13 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.441s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:13 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:13 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Deleted volume successfully. Apr 25 02:16:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-2d9e1c29-a02c-4450-9076-844f0d6f9572 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-d224fe8f-4d80-4dcb-9cf1-1712e61b5dd8-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Flow 'volume_create_manager' (aaadfa49-b432-44ee-9d72-0f7b6d51df15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3f0530-f807-4fb9-9d72-4dfb2f16b075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3f0530-f807-4fb9-9d72-4dfb2f16b075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1688815041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df551b92-07e5-4a6c-bf0d-a785f57fe313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ec3403fffec4561a7e3de4eafc52e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:14Z,use_quota=True,user_id='f904fc75ea5847e18d6a6f4d014059c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b51e43-f48a-43ef-9fe0-70f6a1c5c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b51e43-f48a-43ef-9fe0-70f6a1c5c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68805cb-f027-4381-976b-20525d4fa739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68805cb-f027-4381-976b-20525d4fa739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df551b92-07e5-4a6c-bf0d-a785f57fe313', 'volume_name': 'volume-df551b92-07e5-4a6c-bf0d-a785f57fe313', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b7cbf2-50b7-42d1-9fa4-d4f4cb36408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b7cbf2-50b7-42d1-9fa4-d4f4cb36408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9872401c-b5b0-46c2-9e37-3ea882316bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:14 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Volume df551b92-07e5-4a6c-bf0d-a785f57fe313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df551b92-07e5-4a6c-bf0d-a785f57fe313', 'volume_size': 1} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1688815041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df551b92-07e5-4a6c-bf0d-a785f57fe313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ec3403fffec4561a7e3de4eafc52e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:14Z,use_quota=True,user_id='f904fc75ea5847e18d6a6f4d014059c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Creating volume df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:16:14 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:14 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 1073741824 Apr 25 02:16:14 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:14 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 1073741824" returned: 0 in 0.611s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:14 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 Apr 25 02:16:14 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:15 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313" returned: 0 in 0.499s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:15 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:16:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9872401c-b5b0-46c2-9e37-3ea882316bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df551b92-07e5-4a6c-bf0d-a785f57fe313', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97be284-9322-45fa-9c8e-b120b8d729f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:15 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Volume volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 (df551b92-07e5-4a6c-bf0d-a785f57fe313): created successfully Apr 25 02:16:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97be284-9322-45fa-9c8e-b120b8d729f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:15 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Flow 'volume_create_manager' (aaadfa49-b432-44ee-9d72-0f7b6d51df15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:15 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0a870a27-26e6-4345-8c66-6950f871b40e tempest-VolumeDependencyTests-1970114903 None] Created volume successfully. Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Flow 'volume_create_manager' (031d38f3-9376-4faa-a716-1cfadcc5fd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edacfe18-0089-43ff-804f-0f07a078de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edacfe18-0089-43ff-804f-0f07a078de58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-713882972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334b44d9-0995-43cf-a07c-db8597be7a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ec3403fffec4561a7e3de4eafc52e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=df551b92-07e5-4a6c-bf0d-a785f57fe313,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:17Z,use_quota=True,user_id='f904fc75ea5847e18d6a6f4d014059c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ddecdf-0437-4195-b6e0-6fd4d3a8bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ddecdf-0437-4195-b6e0-6fd4d3a8bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e34f38-aac6-4a72-b95e-9e44f4bd1148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e34f38-aac6-4a72-b95e-9e44f4bd1148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '334b44d9-0995-43cf-a07c-db8597be7a25', 'volume_name': 'volume-334b44d9-0995-43cf-a07c-db8597be7a25', 'volume_size': 1, 'source_volid': 'df551b92-07e5-4a6c-bf0d-a785f57fe313', 'source_volstatus': 'available'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854218ac-0a42-4ab9-bb2c-bdd25b613282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854218ac-0a42-4ab9-bb2c-bdd25b613282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb3c2bd-ccff-48d9-bb63-5d93a53b61a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Volume 334b44d9-0995-43cf-a07c-db8597be7a25: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-334b44d9-0995-43cf-a07c-db8597be7a25', 'volume_size': 1, 'source_volid': 'df551b92-07e5-4a6c-bf0d-a785f57fe313', 'source_volstatus': 'available'} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:16 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Cloning volume df551b92-07e5-4a6c-bf0d-a785f57fe313 to volume 334b44d9-0995-43cf-a07c-db8597be7a25 Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Creating offline snapshot d22941da-eb1d-42fe-8ca8-f416387bb67f of volume df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f2baf5-cb18-4ea7-9ff5-77d368c22a47]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Flow 'volume_create_manager' (c56a24e0-2c82-4d78-b648-769572429f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ccd6fc-f000-4eb4-a7bd-cdce425912e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ccd6fc-f000-4eb4-a7bd-cdce425912e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1159752811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90a35d-6d63-4cb9-b248-f206d720abc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9bc35c3eb45719ea6e92a950d5a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:17Z,use_quota=True,user_id='b683d7ef7e8e48b191a4fc39326b7a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87420e67-2ccd-4ae5-99bc-f379aff05bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 Apr 25 02:16:16 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87420e67-2ccd-4ae5-99bc-f379aff05bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db99d7b-0c1a-4017-b9b2-b78d5da921d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db99d7b-0c1a-4017-b9b2-b78d5da921d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d90a35d-6d63-4cb9-b248-f206d720abc3', 'volume_name': 'volume-7d90a35d-6d63-4cb9-b248-f206d720abc3', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b970504-e683-45b2-a9e1-740d3cd6e43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b970504-e683-45b2-a9e1-740d3cd6e43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974eb7b1-9dd5-47c8-bf74-fde0e2bfac59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:16 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Volume 7d90a35d-6d63-4cb9-b248-f206d720abc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d90a35d-6d63-4cb9-b248-f206d720abc3', 'volume_size': 1} Apr 25 02:16:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:17 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313" returned: 0 in 0.527s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:17 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f 1G Apr 25 02:16:17 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:18 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f 1G" returned: 0 in 0.613s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:18 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f Apr 25 02:16:18 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:18 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f" returned: 0 in 0.477s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:18 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f is being set with open permissions: ugo+rw Apr 25 02:16:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:18 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f Apr 25 02:16:18 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:18 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f" returned: 0 in 0.451s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:18 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.info Apr 25 02:16:18 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:19 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.info" returned: 0 in 0.450s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:19 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.info is being set with open permissions: ugo+rw Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:19 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.info Apr 25 02:16:19 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:19 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.info" returned: 0 in 0.441s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-334b44d9-0995-43cf-a07c-db8597be7a25" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-334b44d9-0995-43cf-a07c-db8597be7a25" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] snapshot: d22941da-eb1d-42fe-8ca8-f416387bb67f, volume: 334b44d9-0995-43cf-a07c-db8597be7a25, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd5b899-2bfe-4b08-b0f8-1cc3c1299ad8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:19 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f Apr 25 02:16:19 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:20 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f" returned: 0 in 0.517s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df551b92-07e5-4a6c-bf0d-a785f57fe313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:16:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:16:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:16:20 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9f9958-15ec-4c41-8ff0-aa9061771c7c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:20 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 Apr 25 02:16:20 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:20 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313" returned: 0 in 0.524s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:20 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:16:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:21 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 Apr 25 02:16:21 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:25 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25" returned: 0 in 4.527s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:25 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4d0424-f65f-482a-9350-6c933167de1b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:25 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 Apr 25 02:16:25 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:26 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313" returned: 0 in 0.626s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:16:26 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Converted 1024.00 MB image at 226.07 MB/s Apr 25 02:16:26 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 is being set with open permissions: ugo+rw Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:26 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 Apr 25 02:16:26 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:26 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25" returned: 0 in 0.429s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-334b44d9-0995-43cf-a07c-db8597be7a25" released by "_copy_volume_from_snapshot" :: held 6.704s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-d22941da-eb1d-42fe-8ca8-f416387bb67f" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-d22941da-eb1d-42fe-8ca8-f416387bb67f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Deleting offline snapshot d22941da-eb1d-42fe-8ca8-f416387bb67f of volume df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] snapshot_file for this snap is: volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[598f6504-753f-4882-925e-a1cc7dd52d70]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:26 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f Apr 25 02:16:26 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:27 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f" returned: 0 in 0.513s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df551b92-07e5-4a6c-bf0d-a785f57fe313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:16:27 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c257a22-9732-4717-8000-1826e71eeba6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:27 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 Apr 25 02:16:27 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:27 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313" returned: 0 in 0.508s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:27 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f Apr 25 02:16:27 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:28 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f" returned: 0 in 0.515s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:28 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f Apr 25 02:16:28 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:28 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313.d22941da-eb1d-42fe-8ca8-f416387bb67f" returned: 0 in 0.430s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-d22941da-eb1d-42fe-8ca8-f416387bb67f" released by "_delete_snapshot" :: held 2.059s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=99,cinder:INSERT=34,cinder:UPDATE=150,cinder:DELETE=10 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=94,cinder:INSERT=32,cinder:UPDATE=131,cinder:DELETE=15 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.911s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.762s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1159752811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90a35d-6d63-4cb9-b248-f206d720abc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9bc35c3eb45719ea6e92a950d5a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:17Z,use_quota=True,user_id='b683d7ef7e8e48b191a4fc39326b7a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Creating volume 7d90a35d-6d63-4cb9-b248-f206d720abc3 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:16:28 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb3c2bd-ccff-48d9-bb63-5d93a53b61a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334b44d9-0995-43cf-a07c-db8597be7a25', 'volume_size': 1, 'source_volid': 'df551b92-07e5-4a6c-bf0d-a785f57fe313', 'source_volstatus': 'available'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48257506-2d73-4efd-aede-0fe85eff3109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:28 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 1073741824 Apr 25 02:16:28 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:28 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Volume volume-334b44d9-0995-43cf-a07c-db8597be7a25 (334b44d9-0995-43cf-a07c-db8597be7a25): created successfully Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48257506-2d73-4efd-aede-0fe85eff3109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Flow 'volume_create_manager' (031d38f3-9376-4faa-a716-1cfadcc5fd37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-7eeb018b-71ef-476b-bb11-1ea460662013 tempest-VolumeDependencyTests-1970114903 None] Created volume successfully. Apr 25 02:16:29 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 1073741824" returned: 0 in 0.609s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:29 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 Apr 25 02:16:29 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-df551b92-07e5-4a6c-bf0d-a785f57fe313-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-df551b92-07e5-4a6c-bf0d-a785f57fe313-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-df551b92-07e5-4a6c-bf0d-a785f57fe313" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-df551b92-07e5-4a6c-bf0d-a785f57fe313" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4339d85b-91d7-4291-a965-64e02f60adde]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:29 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 Apr 25 02:16:29 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:29 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3" returned: 0 in 0.461s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974eb7b1-9dd5-47c8-bf74-fde0e2bfac59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d90a35d-6d63-4cb9-b248-f206d720abc3', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2d8c4f-2ae4-420e-a4cd-a42dc2d6abb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Volume volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 (7d90a35d-6d63-4cb9-b248-f206d720abc3): created successfully Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2d8c4f-2ae4-420e-a4cd-a42dc2d6abb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Flow 'volume_create_manager' (c56a24e0-2c82-4d78-b648-769572429f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:29 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-586145ac-bef2-4eae-bc0e-7148ff4e0034 tempest-VolumesTransfersV355Test-132237824 None] Created volume successfully. Apr 25 02:16:30 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313" returned: 0 in 0.518s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:30 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313 Apr 25 02:16:30 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:30 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-df551b92-07e5-4a6c-bf0d-a785f57fe313" returned: 0 in 0.437s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-df551b92-07e5-4a6c-bf0d-a785f57fe313" released by "delete_volume" :: held 1.027s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Created reservations ['42234253-842e-48e9-8fa6-a1985ba38c3e', 'de440b48-acd3-4523-a595-4f4bd5fac803', '825f46de-d832-4c20-b72d-9c39c06d25fc', '5535dcf8-8951-4876-be85-73d41b13e97b'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:30 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:30 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:31 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.468s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:31 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Deleted volume successfully. Apr 25 02:16:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-44753028-c58b-4ad1-af9d-a3a9e92a1636 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-df551b92-07e5-4a6c-bf0d-a785f57fe313-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e9db5750-5074-434d-8f52-d51744255707 tempest-VolumesTransfersV355Test-1886957624 None] Transfer volume completed successfully. Apr 25 02:16:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-334b44d9-0995-43cf-a07c-db8597be7a25-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-334b44d9-0995-43cf-a07c-db8597be7a25-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-334b44d9-0995-43cf-a07c-db8597be7a25" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-334b44d9-0995-43cf-a07c-db8597be7a25" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:31 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[572ce5b3-9291-4263-8822-6fe6c7ff1aee]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:31 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 Apr 25 02:16:31 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Acquiring lock "cinder-7d90a35d-6d63-4cb9-b248-f206d720abc3-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Lock "cinder-7d90a35d-6d63-4cb9-b248-f206d720abc3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Acquiring lock "cinder-quobyte-7d90a35d-6d63-4cb9-b248-f206d720abc3" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Lock "cinder-quobyte-7d90a35d-6d63-4cb9-b248-f206d720abc3" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e31f713-7b6f-42e1-a97e-ac9b2e4bc0fd]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:32 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 Apr 25 02:16:32 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:32 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25" returned: 0 in 0.582s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:32 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25 Apr 25 02:16:32 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:32 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3" returned: 0 in 0.529s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:32 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3 Apr 25 02:16:32 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:32 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-334b44d9-0995-43cf-a07c-db8597be7a25" returned: 0 in 0.436s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-334b44d9-0995-43cf-a07c-db8597be7a25" released by "delete_volume" :: held 1.078s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:32 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Created reservations ['5133f746-1f33-4efd-829f-f3dc60bd19ee', 'cb640f16-3386-4ecc-8386-bee0545d34d9', '2aa91cd0-8359-4bde-986a-8577c4dceff5', '2d5a7afb-f269-4aae-a46c-374e3d061f2b'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:33 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:33 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:33 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7d90a35d-6d63-4cb9-b248-f206d720abc3" returned: 0 in 0.426s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Lock "cinder-quobyte-7d90a35d-6d63-4cb9-b248-f206d720abc3" released by "delete_volume" :: held 1.004s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Created reservations ['ff92961b-a21a-47bc-9d62-16947430a459', '0114e164-3100-429c-bae1-4b7a489f5470', 'ffabb2f4-c48a-4d39-b49f-cdd82e615c53', '0bd3e76e-9e3a-4456-b6b2-e6a0d5f323a1'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:33 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:33 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:33 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.475s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:33 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Deleted volume successfully. Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-ad4c8fbd-92ec-437a-bdc5-07fba95db216 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-334b44d9-0995-43cf-a07c-db8597be7a25-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:33 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.453s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:33 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Deleted volume successfully. Apr 25 02:16:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a90940e9-4643-4010-a964-c2c477c2029d tempest-VolumesTransfersV355Test-1746578470 None] Lock "cinder-7d90a35d-6d63-4cb9-b248-f206d720abc3-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-ac24728a-ade5-43c7-8364-feec0efe33de-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-ac24728a-ade5-43c7-8364-feec0efe33de-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "cinder-quobyte-ac24728a-ade5-43c7-8364-feec0efe33de" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-ac24728a-ade5-43c7-8364-feec0efe33de" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9207700-94e0-4333-8317-aa794058357a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:34 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de Apr 25 02:16:34 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:34 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de" returned: 0 in 0.549s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:34 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de Apr 25 02:16:34 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Flow 'volume_create_manager' (3c244a39-afba-43b4-99d2-5d9b5ff63503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f99209-8025-4963-9727-113e046c1d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f99209-8025-4963-9727-113e046c1d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1052958508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac50f29-de61-4dd7-98f9-1109a810b1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9bc35c3eb45719ea6e92a950d5a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:35Z,use_quota=True,user_id='b683d7ef7e8e48b191a4fc39326b7a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddb1341-4856-4857-b3ec-b6db4295e652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddb1341-4856-4857-b3ec-b6db4295e652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b9032a-90a2-463c-94f6-78ba23bf17e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b9032a-90a2-463c-94f6-78ba23bf17e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bac50f29-de61-4dd7-98f9-1109a810b1de', 'volume_name': 'volume-bac50f29-de61-4dd7-98f9-1109a810b1de', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62a1919-5d5f-426d-92eb-6dd3085daf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62a1919-5d5f-426d-92eb-6dd3085daf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f97488-140a-47cd-a3e4-dc3573225000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:34 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Volume bac50f29-de61-4dd7-98f9-1109a810b1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bac50f29-de61-4dd7-98f9-1109a810b1de', 'volume_size': 1} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1052958508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac50f29-de61-4dd7-98f9-1109a810b1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf9bc35c3eb45719ea6e92a950d5a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:35Z,use_quota=True,user_id='b683d7ef7e8e48b191a4fc39326b7a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Creating volume bac50f29-de61-4dd7-98f9-1109a810b1de {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:16:34 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:16:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:34 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de 1073741824 Apr 25 02:16:34 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:35 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ac24728a-ade5-43c7-8364-feec0efe33de" returned: 0 in 0.458s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-quobyte-ac24728a-ade5-43c7-8364-feec0efe33de" released by "delete_volume" :: held 1.046s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Created reservations ['1df2cde6-3b47-421e-97c4-5857749d5386', '98da0f86-8c58-46df-a796-20ac6f961a64', '30d17e0e-7742-4033-87b9-55616ed8c48a', '2ee0af56-db08-4ab9-ab23-693c1b4d5357'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:35 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:35 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:35 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de 1073741824" returned: 0 in 0.616s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:35 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de Apr 25 02:16:35 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:35 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.459s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:35 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Deleted volume successfully. Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-d45d4b16-4ead-4959-93bd-3f3b0fb00b02 tempest-VolumeDependencyTests-1970114903 None] Lock "cinder-ac24728a-ade5-43c7-8364-feec0efe33de-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:35 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de" returned: 0 in 0.452s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f97488-140a-47cd-a3e4-dc3573225000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bac50f29-de61-4dd7-98f9-1109a810b1de', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65585a81-6b1a-4f37-92e5-b95514c424aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:35 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Volume volume-bac50f29-de61-4dd7-98f9-1109a810b1de (bac50f29-de61-4dd7-98f9-1109a810b1de): created successfully Apr 25 02:16:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65585a81-6b1a-4f37-92e5-b95514c424aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:36 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Flow 'volume_create_manager' (3c244a39-afba-43b4-99d2-5d9b5ff63503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:36 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e74cd411-3194-463b-8b30-178e1bc857b4 tempest-VolumesTransfersV355Test-132237824 None] Created volume successfully. Apr 25 02:16:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Acquiring lock "cinder-bac50f29-de61-4dd7-98f9-1109a810b1de-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Lock "cinder-bac50f29-de61-4dd7-98f9-1109a810b1de-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Acquiring lock "cinder-quobyte-bac50f29-de61-4dd7-98f9-1109a810b1de" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Lock "cinder-quobyte-bac50f29-de61-4dd7-98f9-1109a810b1de" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:37 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b772f2-410c-4a40-acbb-5bf4785cc817]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:37 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de Apr 25 02:16:37 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:37 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de" returned: 0 in 0.578s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:37 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de Apr 25 02:16:37 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:38 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bac50f29-de61-4dd7-98f9-1109a810b1de" returned: 0 in 0.436s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Lock "cinder-quobyte-bac50f29-de61-4dd7-98f9-1109a810b1de" released by "delete_volume" :: held 1.061s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Created reservations ['64c00a73-c072-483d-ac21-73c28eb15248', '1a0b125a-8878-4bb9-9acd-a0b1a50257aa', '1d6af416-eaa6-47d0-953c-93f223649dc0', '39c867fd-4d04-4aa9-918f-11326fe16160'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:38 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:38 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:38 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.428s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:38 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Deleted volume successfully. Apr 25 02:16:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c5b9c040-17a0-44bd-9716-0ca5339d6d03 tempest-VolumesTransfersV355Test-1746578470 None] Lock "cinder-bac50f29-de61-4dd7-98f9-1109a810b1de-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Flow 'volume_create_manager' (c5280186-42b4-4347-9569-32aceaf501a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef640e9-1ac7-48a5-be16-d2a163e1ba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef640e9-1ac7-48a5-be16-d2a163e1ba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382954420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14616420-ba1c-4aac-a04b-462f8a67d200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a7818fed864c66aa950e613f929043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:45Z,use_quota=True,user_id='66885b4c66f647dcb7a33a364475afa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9352648-3825-41cf-987e-92a8b8562736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9352648-3825-41cf-987e-92a8b8562736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861cfb7c-966f-4e61-a41a-3eb34d4c5b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861cfb7c-966f-4e61-a41a-3eb34d4c5b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14616420-ba1c-4aac-a04b-462f8a67d200', 'volume_name': 'volume-14616420-ba1c-4aac-a04b-462f8a67d200', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73927ef-9295-45ce-929e-49059cc79732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73927ef-9295-45ce-929e-49059cc79732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542b2b19-3c25-4654-bb26-7ad8065e967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:45 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Volume 14616420-ba1c-4aac-a04b-462f8a67d200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14616420-ba1c-4aac-a04b-462f8a67d200', 'volume_size': 1} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1382954420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14616420-ba1c-4aac-a04b-462f8a67d200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a7818fed864c66aa950e613f929043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:45Z,use_quota=True,user_id='66885b4c66f647dcb7a33a364475afa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Creating volume 14616420-ba1c-4aac-a04b-462f8a67d200 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:16:45 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:45 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200 1073741824 Apr 25 02:16:45 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:45 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200 1073741824" returned: 0 in 0.599s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:45 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200 Apr 25 02:16:45 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:46 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200" returned: 0 in 0.423s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:46 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:16:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542b2b19-3c25-4654-bb26-7ad8065e967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14616420-ba1c-4aac-a04b-462f8a67d200', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518220fd-71eb-4427-a8df-5634cba41f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:46 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Volume volume-14616420-ba1c-4aac-a04b-462f8a67d200 (14616420-ba1c-4aac-a04b-462f8a67d200): created successfully Apr 25 02:16:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518220fd-71eb-4427-a8df-5634cba41f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:46 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Flow 'volume_create_manager' (c5280186-42b4-4347-9569-32aceaf501a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:46 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-6992e82d-7731-44e3-b883-ce1d0267da7b tempest-VolumesTransfersV357Test-1340513780 None] Created volume successfully. Apr 25 02:16:47 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d036affb-58bd-4f67-82a2-1eceabb62aad tempest-VolumesTransfersV357Test-520893372 None] Transfer volume completed successfully. Apr 25 02:16:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Acquiring lock "cinder-14616420-ba1c-4aac-a04b-462f8a67d200-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Lock "cinder-14616420-ba1c-4aac-a04b-462f8a67d200-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Acquiring lock "cinder-quobyte-14616420-ba1c-4aac-a04b-462f8a67d200" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Lock "cinder-quobyte-14616420-ba1c-4aac-a04b-462f8a67d200" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:48 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbb6f59-e0a0-4540-b8b5-3a61336456dc]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:48 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200 Apr 25 02:16:48 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:49 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200" returned: 0 in 0.504s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:49 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200 Apr 25 02:16:49 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:49 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-14616420-ba1c-4aac-a04b-462f8a67d200" returned: 0 in 0.439s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Lock "cinder-quobyte-14616420-ba1c-4aac-a04b-462f8a67d200" released by "delete_volume" :: held 0.985s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Created reservations ['38fc9454-b9f4-4f7d-ac07-5112910fef2a', '4f2e28b6-17ae-4d9b-9e71-d8dac2a394f8', '79e02333-cdb8-400e-bea5-5ec784493219', '525acbdb-b046-4269-be0d-9a50f4c3fbbd'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:49 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:49 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:50 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.435s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:50 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:50 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Deleted volume successfully. Apr 25 02:16:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-77543efe-574b-4c5b-bd98-e13d9d3101dc tempest-VolumesTransfersV357Test-474883123 None] Lock "cinder-14616420-ba1c-4aac-a04b-462f8a67d200-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Flow 'volume_create_manager' (f5653b3b-cd93-494d-9671-a03df7b831b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbcef05-6340-40de-9fe5-5a23de5a7faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbcef05-6340-40de-9fe5-5a23de5a7faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-987984043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddc5095-3dba-4dff-be38-dfdb9171f35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a7818fed864c66aa950e613f929043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:51Z,use_quota=True,user_id='66885b4c66f647dcb7a33a364475afa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855d605e-8396-4dcc-bdfd-ccabb6cff128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855d605e-8396-4dcc-bdfd-ccabb6cff128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5503e03-9627-407c-a752-3e40b5bc9b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5503e03-9627-407c-a752-3e40b5bc9b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dddc5095-3dba-4dff-be38-dfdb9171f35d', 'volume_name': 'volume-dddc5095-3dba-4dff-be38-dfdb9171f35d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c180a70-f6af-4ca9-82db-e0a4980c730f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c180a70-f6af-4ca9-82db-e0a4980c730f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560d49e8-0266-41ab-8007-3362cd91a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Volume dddc5095-3dba-4dff-be38-dfdb9171f35d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dddc5095-3dba-4dff-be38-dfdb9171f35d', 'volume_size': 1} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-987984043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dddc5095-3dba-4dff-be38-dfdb9171f35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a7818fed864c66aa950e613f929043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:16:51Z,use_quota=True,user_id='66885b4c66f647dcb7a33a364475afa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Creating volume dddc5095-3dba-4dff-be38-dfdb9171f35d {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:16:51 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:51 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d 1073741824 Apr 25 02:16:51 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:51 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d 1073741824" returned: 0 in 0.606s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:51 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d Apr 25 02:16:51 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:52 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d" returned: 0 in 0.441s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:16:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560d49e8-0266-41ab-8007-3362cd91a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dddc5095-3dba-4dff-be38-dfdb9171f35d', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966b639f-cfaa-4388-a073-bbe0385d58a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:16:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Volume volume-dddc5095-3dba-4dff-be38-dfdb9171f35d (dddc5095-3dba-4dff-be38-dfdb9171f35d): created successfully Apr 25 02:16:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966b639f-cfaa-4388-a073-bbe0385d58a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:16:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Flow 'volume_create_manager' (f5653b3b-cd93-494d-9671-a03df7b831b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:16:52 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-d286a60b-4eb2-439b-8e06-a31c100d5cd2 tempest-VolumesTransfersV357Test-1340513780 None] Created volume successfully. Apr 25 02:16:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Acquiring lock "cinder-dddc5095-3dba-4dff-be38-dfdb9171f35d-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Lock "cinder-dddc5095-3dba-4dff-be38-dfdb9171f35d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Acquiring lock "cinder-quobyte-dddc5095-3dba-4dff-be38-dfdb9171f35d" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:16:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Lock "cinder-quobyte-dddc5095-3dba-4dff-be38-dfdb9171f35d" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:16:53 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[7044ef7b-f312-4a99-a75d-7ba4cbea95e7]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:16:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:53 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d Apr 25 02:16:53 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:54 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d" returned: 0 in 0.532s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:54 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d Apr 25 02:16:54 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:54 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-dddc5095-3dba-4dff-be38-dfdb9171f35d" returned: 0 in 0.434s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Lock "cinder-quobyte-dddc5095-3dba-4dff-be38-dfdb9171f35d" released by "delete_volume" :: held 1.008s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Created reservations ['a6372e01-711d-4ffd-bd07-48ad6b2fd59a', 'a0101f94-77e9-4c6a-832e-86df7d88dc6a', '4d487662-372d-4bf6-9850-46c49b537a05', '4fe53e7f-79e2-46fe-929f-f748c0a7817f'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:16:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:16:54 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:16:54 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:16:55 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 25 02:16:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.437s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:16:55 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:16:55 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Deleted volume successfully. Apr 25 02:16:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a028940-98e3-4919-94a5-f691ee717b00 tempest-VolumesTransfersV357Test-474883123 None] Lock "cinder-dddc5095-3dba-4dff-be38-dfdb9171f35d-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Flow 'volume_create_manager' (6560f29f-455e-4275-9135-08e1be7acba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94e3b2b-7459-40a5-ba51-34c31e19090c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94e3b2b-7459-40a5-ba51-34c31e19090c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1843914205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca97f9d-a936-4dea-a81f-bde87de3f65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84da08cd046478abc17a992bed2d6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:00Z,use_quota=True,user_id='10822447ad624c729de9660db6e6d689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49378bc5-5fa5-49c6-8469-c6e7064722ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49378bc5-5fa5-49c6-8469-c6e7064722ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1d0be7-e065-44f2-93c9-3c55fb2eaf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1d0be7-e065-44f2-93c9-3c55fb2eaf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca97f9d-a936-4dea-a81f-bde87de3f65b', 'volume_name': 'volume-cca97f9d-a936-4dea-a81f-bde87de3f65b', 'volume_size': 2}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eada482-9e6e-4f39-a14c-ebfb23057a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eada482-9e6e-4f39-a14c-ebfb23057a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34962fb5-0d3a-40f4-80fc-f105e919541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:00 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Volume cca97f9d-a936-4dea-a81f-bde87de3f65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca97f9d-a936-4dea-a81f-bde87de3f65b', 'volume_size': 2} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1843914205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca97f9d-a936-4dea-a81f-bde87de3f65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84da08cd046478abc17a992bed2d6ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:00Z,use_quota=True,user_id='10822447ad624c729de9660db6e6d689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Creating volume cca97f9d-a936-4dea-a81f-bde87de3f65b {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:00 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b 2147483648 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:00 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b 2147483648 Apr 25 02:17:00 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:00 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b 2147483648" returned: 0 in 0.620s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:00 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b Apr 25 02:17:00 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:01 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b" returned: 0 in 0.453s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34962fb5-0d3a-40f4-80fc-f105e919541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca97f9d-a936-4dea-a81f-bde87de3f65b', 'volume_size': 2}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8aa3a9-4c23-4f6e-9843-a4677f3894de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:01 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Volume volume-cca97f9d-a936-4dea-a81f-bde87de3f65b (cca97f9d-a936-4dea-a81f-bde87de3f65b): created successfully Apr 25 02:17:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8aa3a9-4c23-4f6e-9843-a4677f3894de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Flow 'volume_create_manager' (6560f29f-455e-4275-9135-08e1be7acba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:01 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-304666ab-51f8-46ed-99da-a6c48258e46b tempest-VolumesCloneNegativeTest-1368428640 None] Created volume successfully. Apr 25 02:17:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Acquiring lock "cinder-cca97f9d-a936-4dea-a81f-bde87de3f65b-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Lock "cinder-cca97f9d-a936-4dea-a81f-bde87de3f65b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Acquiring lock "cinder-quobyte-cca97f9d-a936-4dea-a81f-bde87de3f65b" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Lock "cinder-quobyte-cca97f9d-a936-4dea-a81f-bde87de3f65b" acquired by "delete_volume" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:02 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6108aa-d3e6-4426-b0a6-c629499cba4b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:02 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b Apr 25 02:17:02 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:02 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b" returned: 0 in 0.515s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:02 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b Apr 25 02:17:02 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:03 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cca97f9d-a936-4dea-a81f-bde87de3f65b" returned: 0 in 0.425s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Lock "cinder-quobyte-cca97f9d-a936-4dea-a81f-bde87de3f65b" released by "delete_volume" :: held 0.979s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Created reservations ['38f7d860-f56c-435f-85c8-2a1ac5c09a86', '789e6684-9984-4129-a9d9-04320a7f8c75', '8bc72332-7949-4fb4-85ce-c277ba1927e2', '13c18c68-3ac8-411d-af20-2ea768845955'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:03 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:17:03 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:03 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.451s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:17:03 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Deleted volume successfully. Apr 25 02:17:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-be5e0a8c-a332-4771-b121-9603e5737877 tempest-VolumesCloneNegativeTest-1368428640 None] Lock "cinder-cca97f9d-a936-4dea-a81f-bde87de3f65b-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (3164863b-189e-4b5a-a052-6dac6cb20206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3305ae56-704e-40b6-902c-085d8458755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3305ae56-704e-40b6-902c-085d8458755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439537373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:07Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2e7b41-b557-4f40-9115-c20a51d84ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b2e7b41-b557-4f40-9115-c20a51d84ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a0176e-0c96-4cc0-b7ec-8e5d755869b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a0176e-0c96-4cc0-b7ec-8e5d755869b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe', 'volume_name': 'volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd45958-3657-4349-8f88-6b76b2436845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd45958-3657-4349-8f88-6b76b2436845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e32edf-77b1-4bac-b19e-d69f854a4963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:06 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Volume 7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe', 'volume_size': 1} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-439537373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:07Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Creating volume 7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:07 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:07 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe 1073741824 Apr 25 02:17:07 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (ea4fe547-913f-4309-872d-b29953958fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502fa28c-b3a9-493d-80ba-2d65c81f617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502fa28c-b3a9-493d-80ba-2d65c81f617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1937922702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad176218-4aaf-4753-a49d-c399b1a1d845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:07Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62bbdc6-cea8-4013-8e4a-dbcc5d27ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62bbdc6-cea8-4013-8e4a-dbcc5d27ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2d43f3-12e2-4750-8b5c-a5a0db3476d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb2d43f3-12e2-4750-8b5c-a5a0db3476d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad176218-4aaf-4753-a49d-c399b1a1d845', 'volume_name': 'volume-ad176218-4aaf-4753-a49d-c399b1a1d845', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381d2598-5390-499b-abf0-25b5768d99ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381d2598-5390-499b-abf0-25b5768d99ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1a6060-8962-4398-95ba-30bcf5db4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Volume ad176218-4aaf-4753-a49d-c399b1a1d845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad176218-4aaf-4753-a49d-c399b1a1d845', 'volume_size': 1} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (f562a9f7-a04b-4c9d-9895-0359ded2cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7987c99-fde8-4604-893d-60d3ac5d9c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7987c99-fde8-4604-893d-60d3ac5d9c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55530110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d5d704-a28a-46ca-93fc-bab27fadffdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:07Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bc2203-67ad-4e0c-9c03-7a9aacb482c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41bc2203-67ad-4e0c-9c03-7a9aacb482c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151169e1-c9ee-4fea-9cd9-f39e2954eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151169e1-c9ee-4fea-9cd9-f39e2954eb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d5d704-a28a-46ca-93fc-bab27fadffdb', 'volume_name': 'volume-02d5d704-a28a-46ca-93fc-bab27fadffdb', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90299ac-acba-45d6-bea6-d7d11a1014da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90299ac-acba-45d6-bea6-d7d11a1014da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b7bbb6-63b7-4510-bbcc-d75eeb21329d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Volume 02d5d704-a28a-46ca-93fc-bab27fadffdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d5d704-a28a-46ca-93fc-bab27fadffdb', 'volume_size': 1} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:07 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe 1073741824" returned: 0 in 0.718s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:07 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe Apr 25 02:17:07 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (4b7f40b2-7bed-4032-90b6-0db55f35ccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bb3719-6113-4c65-90cb-6dc2a1fe2472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bb3719-6113-4c65-90cb-6dc2a1fe2472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230263370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65f5abf-062e-4d7b-b18b-cdca552fcfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:08Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01e8129-e662-4076-9319-d0c07ac3ce0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f01e8129-e662-4076-9319-d0c07ac3ce0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc810818-4763-45f4-aed2-67553b6024ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc810818-4763-45f4-aed2-67553b6024ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65f5abf-062e-4d7b-b18b-cdca552fcfb6', 'volume_name': 'volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0cf030-a87f-48c4-90a8-3c6e327288ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0cf030-a87f-48c4-90a8-3c6e327288ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80e6e0b-f6c1-4db9-a768-2deb9fa71589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:07 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Volume a65f5abf-062e-4d7b-b18b-cdca552fcfb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6', 'volume_size': 1} Apr 25 02:17:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (6ed3e264-33b3-412e-976f-f242f370507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c8746-443f-40ef-a77e-b39acf26702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5c8746-443f-40ef-a77e-b39acf26702d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-549678738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5403fb-a4db-4541-a2b0-37cc4f6ab760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:08Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ebd15c-9ed4-4b7f-b1b6-831f93a79565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ebd15c-9ed4-4b7f-b1b6-831f93a79565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6684f7-f939-44e6-816e-3640347bc647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6684f7-f939-44e6-816e-3640347bc647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e5403fb-a4db-4541-a2b0-37cc4f6ab760', 'volume_name': 'volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e94337e-91e6-4545-a19b-02d86ed6d88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e94337e-91e6-4545-a19b-02d86ed6d88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c694424a-33b9-4497-bb11-a8e0384ea301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:08 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Volume 8e5403fb-a4db-4541-a2b0-37cc4f6ab760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760', 'volume_size': 1} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:08 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe" returned: 0 in 0.467s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1937922702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad176218-4aaf-4753-a49d-c399b1a1d845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:07Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Creating volume ad176218-4aaf-4753-a49d-c399b1a1d845 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:08 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e32edf-77b1-4bac-b19e-d69f854a4963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2409830-3d48-4dfa-bc64-e216a3fe2107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:08 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845 1073741824 Apr 25 02:17:08 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:08 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Volume volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe (7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe): created successfully Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2409830-3d48-4dfa-bc64-e216a3fe2107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (3164863b-189e-4b5a-a052-6dac6cb20206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:08 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e46fd20e-856a-4219-ac18-0c0fcb550106 tempest-CreateVolumesFromImageTest-1970709623 None] Created volume successfully. Apr 25 02:17:08 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845 1073741824" returned: 0 in 0.608s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:08 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845 Apr 25 02:17:08 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:09 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845" returned: 0 in 0.444s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.776s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55530110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d5d704-a28a-46ca-93fc-bab27fadffdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:07Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Creating volume 02d5d704-a28a-46ca-93fc-bab27fadffdb {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:09 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1a6060-8962-4398-95ba-30bcf5db4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad176218-4aaf-4753-a49d-c399b1a1d845', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3194b1b9-143a-4011-b152-7bf963814cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:09 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb 1073741824 Apr 25 02:17:09 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:09 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Volume volume-ad176218-4aaf-4753-a49d-c399b1a1d845 (ad176218-4aaf-4753-a49d-c399b1a1d845): created successfully Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3194b1b9-143a-4011-b152-7bf963814cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (ea4fe547-913f-4309-872d-b29953958fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:09 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a9786216-934a-4d57-badf-25d7da529fe3 tempest-CreateVolumesFromImageTest-1970709623 None] Created volume successfully. Apr 25 02:17:09 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb 1073741824" returned: 0 in 0.644s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:10 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb Apr 25 02:17:10 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:10 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb" returned: 0 in 0.461s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.592s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230263370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65f5abf-062e-4d7b-b18b-cdca552fcfb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:08Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Creating volume a65f5abf-062e-4d7b-b18b-cdca552fcfb6 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:10 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b7bbb6-63b7-4510-bbcc-d75eeb21329d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d5d704-a28a-46ca-93fc-bab27fadffdb', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa004d90-6df0-4b04-96cd-7faa0448c5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:10 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 1073741824 Apr 25 02:17:10 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:10 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Volume volume-02d5d704-a28a-46ca-93fc-bab27fadffdb (02d5d704-a28a-46ca-93fc-bab27fadffdb): created successfully Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa004d90-6df0-4b04-96cd-7faa0448c5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (f562a9f7-a04b-4c9d-9895-0359ded2cc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:10 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-999ab4a7-5aec-42a5-910a-d8bff21c2f12 tempest-CreateVolumesFromImageTest-1970709623 None] Created volume successfully. Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:11 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 1073741824" returned: 0 in 0.630s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:11 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:17:11 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:11 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 Apr 25 02:17:11 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:11 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.467s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:17:11 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6" returned: 0 in 0.471s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.461s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-549678738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e5403fb-a4db-4541-a2b0-37cc4f6ab760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15102b74412741079591f5192824d741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:08Z,use_quota=True,user_id='a5279d84a5f943c799e765f1d10257fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Creating volume 8e5403fb-a4db-4541-a2b0-37cc4f6ab760 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:11 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:11 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 1073741824 Apr 25 02:17:11 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80e6e0b-f6c1-4db9-a768-2deb9fa71589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63315a14-b42a-4aff-a0a1-a4fed55a068a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:11 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Volume volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 (a65f5abf-062e-4d7b-b18b-cdca552fcfb6): created successfully Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63315a14-b42a-4aff-a0a1-a4fed55a068a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (4b7f40b2-7bed-4032-90b6-0db55f35ccef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:11 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-009dcb75-04d7-4f2d-97d9-be52c2eb97c0 tempest-CreateVolumesFromImageTest-1970709623 None] Created volume successfully. Apr 25 02:17:12 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 1073741824" returned: 0 in 0.608s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:12 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 Apr 25 02:17:12 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:12 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760" returned: 0 in 0.443s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c694424a-33b9-4497-bb11-a8e0384ea301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21638afe-5bc5-4eda-85fc-172add5a653d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:12 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Volume volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 (8e5403fb-a4db-4541-a2b0-37cc4f6ab760): created successfully Apr 25 02:17:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21638afe-5bc5-4eda-85fc-172add5a653d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:12 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Flow 'volume_create_manager' (6ed3e264-33b3-412e-976f-f242f370507d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:12 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dc57bc33-c849-4d4d-8089-1a4b00778726 tempest-CreateVolumesFromImageTest-1970709623 None] Created volume successfully. Apr 25 02:17:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-8e5403fb-a4db-4541-a2b0-37cc4f6ab760-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-8e5403fb-a4db-4541-a2b0-37cc4f6ab760-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-quobyte-8e5403fb-a4db-4541-a2b0-37cc4f6ab760" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-8e5403fb-a4db-4541-a2b0-37cc4f6ab760" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:13 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[85074c95-231b-4eab-b8db-2e8209dfaaa6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:13 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 Apr 25 02:17:13 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:14 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760" returned: 0 in 0.514s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:14 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760 Apr 25 02:17:14 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:14 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-8e5403fb-a4db-4541-a2b0-37cc4f6ab760" returned: 0 in 0.427s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-8e5403fb-a4db-4541-a2b0-37cc4f6ab760" released by "delete_volume" :: held 0.982s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Created reservations ['b9b55fc1-b8b9-4400-9b48-682cd423c37f', 'b6b9eb49-b0be-4421-9d6a-7a116eff8a73', '1e79f59f-d4f4-4d92-b777-7ed47912c0de', '99cae1b8-6554-4218-96cf-0797e60db0d0'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:14 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:17:14 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:15 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.449s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:15 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:17:15 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Deleted volume successfully. Apr 25 02:17:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-8209ea9d-0d07-463c-9d7b-1b790e937e53 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-8e5403fb-a4db-4541-a2b0-37cc4f6ab760-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-a65f5abf-062e-4d7b-b18b-cdca552fcfb6-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-a65f5abf-062e-4d7b-b18b-cdca552fcfb6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-quobyte-a65f5abf-062e-4d7b-b18b-cdca552fcfb6" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:15 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-a65f5abf-062e-4d7b-b18b-cdca552fcfb6" acquired by "delete_volume" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:15 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9cdb91-7e6d-4d2b-842e-2d578c89c69e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:15 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:15 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 Apr 25 02:17:15 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:16 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6" returned: 0 in 0.520s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:16 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6 Apr 25 02:17:16 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:16 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-a65f5abf-062e-4d7b-b18b-cdca552fcfb6" returned: 0 in 0.435s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-a65f5abf-062e-4d7b-b18b-cdca552fcfb6" released by "delete_volume" :: held 0.995s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Created reservations ['ef44e556-6f85-4775-a5f3-6fd2acea7170', '6cf79c47-68b2-4331-b8b3-01054154f0b1', '8079b505-321c-4d47-96b8-d22f0708b951', '7acbb7a6-5fae-41fb-8988-bd4de21f6cdc'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:17 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:17:17 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:17 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.438s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:17 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:17:17 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Deleted volume successfully. Apr 25 02:17:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-92464703-8111-4a1f-8a23-76cb9964b8c4 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-a65f5abf-062e-4d7b-b18b-cdca552fcfb6-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-02d5d704-a28a-46ca-93fc-bab27fadffdb-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-02d5d704-a28a-46ca-93fc-bab27fadffdb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-quobyte-02d5d704-a28a-46ca-93fc-bab27fadffdb" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-02d5d704-a28a-46ca-93fc-bab27fadffdb" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:18 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef87480-1e01-45d9-83e9-9cab16373f24]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:18 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb Apr 25 02:17:18 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:18 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb" returned: 0 in 0.498s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:18 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb Apr 25 02:17:18 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:19 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-02d5d704-a28a-46ca-93fc-bab27fadffdb" returned: 0 in 0.451s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-02d5d704-a28a-46ca-93fc-bab27fadffdb" released by "delete_volume" :: held 0.987s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Created reservations ['6f29d9bb-a14a-4fd0-8098-81e83d938d58', 'ee652bfd-7400-4722-9765-bfc9c9eda2f0', 'a3ad48fa-7aa3-4933-9c6b-5c51d366aaf1', '4f15f457-8a61-4d1e-8dce-7efc32c5682e'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:19 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:17:19 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:19 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.429s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:17:19 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Deleted volume successfully. Apr 25 02:17:19 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c10a52a5-dabd-424b-bdf7-755a31fc9e12 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-02d5d704-a28a-46ca-93fc-bab27fadffdb-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:20 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-ad176218-4aaf-4753-a49d-c399b1a1d845-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:20 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-ad176218-4aaf-4753-a49d-c399b1a1d845-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:20 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-quobyte-ad176218-4aaf-4753-a49d-c399b1a1d845" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:20 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-ad176218-4aaf-4753-a49d-c399b1a1d845" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:20 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d8ad58-a2ee-4233-9bc6-364b8c963f4e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:20 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845 Apr 25 02:17:20 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:20 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845" returned: 0 in 0.516s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:20 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845 Apr 25 02:17:20 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:21 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-ad176218-4aaf-4753-a49d-c399b1a1d845" returned: 0 in 0.427s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-ad176218-4aaf-4753-a49d-c399b1a1d845" released by "delete_volume" :: held 0.990s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Created reservations ['d09a7d70-3cfc-44cb-9fee-83f96eeaf39e', 'fc70bd79-e0e0-4a58-91b1-cafbaafdb499', '2dbbed1b-8a54-4f72-8ac4-be6365e4f13d', 'a750e7e6-7295-44cb-950c-d81b1becccaf'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:21 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:17:21 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:21 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.433s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:17:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Deleted volume successfully. Apr 25 02:17:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3a9a9265-3a44-4336-9a24-a5b881bf4f7e tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-ad176218-4aaf-4753-a49d-c399b1a1d845-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "cinder-quobyte-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:22 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[97078fed-1752-4bc5-b61e-9d0871570881]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:22 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe Apr 25 02:17:22 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:23 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe" returned: 0 in 0.487s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:23 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe Apr 25 02:17:23 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:23 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe" returned: 0 in 0.440s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-quobyte-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe" released by "delete_volume" :: held 0.967s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Created reservations ['8eae2df5-1185-4026-b577-82b398f4986a', '0d0cea90-48cb-4373-9a20-c42580036324', '94c85d71-9c5a-42d1-b9fd-135a95a24ec7', 'a0763cc9-e2cd-4946-9c1c-ab6c3c1c46d2'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:23 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:17:23 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:24 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.420s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:24 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:17:24 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Deleted volume successfully. Apr 25 02:17:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c90ce149-84d3-4cda-82af-7065431c74b7 tempest-CreateVolumesFromImageTest-1970709623 None] Lock "cinder-7ff52f8f-2cc0-4b87-a1a6-bcf3bfa52cbe-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Flow 'volume_create_manager' (404b06c0-1354-40fb-bbab-1214f035b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3575c74-5d8f-4bd1-9641-4b70126c39b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3575c74-5d8f-4bd1-9641-4b70126c39b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7e45e7-ab6a-4b5a-88a6-c68773d027a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85bee24d6f9741b6981870363c21056d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:27Z,use_quota=True,user_id='784d2abfecd54fa0a89f4e1d765eb5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5555efd-aff8-4055-ab02-e5732c901b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5555efd-aff8-4055-ab02-e5732c901b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66393c80-d10a-4a27-88dc-24a8a601b94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66393c80-d10a-4a27-88dc-24a8a601b94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7e45e7-ab6a-4b5a-88a6-c68773d027a5', 'volume_name': 'volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79ab974-2b9c-45d2-ba25-6a1191e1a755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d79ab974-2b9c-45d2-ba25-6a1191e1a755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d7a53f-3ec6-4ff7-a110-ff8d5c97dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:27 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Volume 1f7e45e7-ab6a-4b5a-88a6-c68773d027a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5', 'volume_size': 1} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7e45e7-ab6a-4b5a-88a6-c68773d027a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85bee24d6f9741b6981870363c21056d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:27Z,use_quota=True,user_id='784d2abfecd54fa0a89f4e1d765eb5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Creating volume 1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:27 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:27 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 1073741824 Apr 25 02:17:27 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:27 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 1073741824" returned: 0 in 0.601s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:27 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 Apr 25 02:17:27 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:28 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5" returned: 0 in 0.432s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d7a53f-3ec6-4ff7-a110-ff8d5c97dea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8f27bb-2173-4d26-b6bf-c2bc6ca0d8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:28 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Volume volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 (1f7e45e7-ab6a-4b5a-88a6-c68773d027a5): created successfully Apr 25 02:17:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8f27bb-2173-4d26-b6bf-c2bc6ca0d8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Flow 'volume_create_manager' (404b06c0-1354-40fb-bbab-1214f035b829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a151c1b2-b70f-4c49-a988-c8bb4f7a7375 tempest-CinderUnicodeTest-507855702 None] Created volume successfully. Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=146,cinder:DELETE=12,cinder:SELECT=84,cinder:INSERT=31 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=94,cinder:UPDATE=133,cinder:INSERT=33,cinder:DELETE=13 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Flow 'volume_create_manager' (a2976074-00b8-4b58-877d-496bd43ee862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8954d690-84e8-4afe-9583-b7913949b9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8954d690-84e8-4afe-9583-b7913949b9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-857787100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018a953a-bf76-4799-bb6e-b05d641bbe4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85bee24d6f9741b6981870363c21056d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:29Z,use_quota=True,user_id='784d2abfecd54fa0a89f4e1d765eb5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c501341a-e11c-4c0d-b531-24af9a318c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c501341a-e11c-4c0d-b531-24af9a318c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3603e102-3ed4-4cb4-8a41-8a6032da3a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3603e102-3ed4-4cb4-8a41-8a6032da3a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018a953a-bf76-4799-bb6e-b05d641bbe4a', 'volume_name': 'volume-018a953a-bf76-4799-bb6e-b05d641bbe4a', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d0b3fd-e949-4556-a4cf-a7a6d4f33c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d0b3fd-e949-4556-a4cf-a7a6d4f33c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bdc493-dfe2-4820-a1ef-9c70d7380682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:29 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Volume 018a953a-bf76-4799-bb6e-b05d641bbe4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018a953a-bf76-4799-bb6e-b05d641bbe4a', 'volume_size': 1} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-857787100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018a953a-bf76-4799-bb6e-b05d641bbe4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85bee24d6f9741b6981870363c21056d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:29Z,use_quota=True,user_id='784d2abfecd54fa0a89f4e1d765eb5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Creating volume 018a953a-bf76-4799-bb6e-b05d641bbe4a {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:29 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:29 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a 1073741824 Apr 25 02:17:29 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:30 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a 1073741824" returned: 0 in 0.588s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:30 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a Apr 25 02:17:30 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:30 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a" returned: 0 in 0.449s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bdc493-dfe2-4820-a1ef-9c70d7380682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018a953a-bf76-4799-bb6e-b05d641bbe4a', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12409d2f-2f31-4d9a-b48b-4ad247e86f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:30 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Volume volume-018a953a-bf76-4799-bb6e-b05d641bbe4a (018a953a-bf76-4799-bb6e-b05d641bbe4a): created successfully Apr 25 02:17:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12409d2f-2f31-4d9a-b48b-4ad247e86f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:30 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Flow 'volume_create_manager' (a2976074-00b8-4b58-877d-496bd43ee862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:30 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-42f096a0-7454-47ba-a2fa-f5e604fec01e tempest-CinderUnicodeTest-507855702 None] Created volume successfully. Apr 25 02:17:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Creating offline snapshot 4fd2be85-97a6-4891-9695-0dea59ef6b3c of volume 018a953a-bf76-4799-bb6e-b05d641bbe4a {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:17:31 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d22c9-ec01-418a-b007-1d5796072054]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:31 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a Apr 25 02:17:31 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:32 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a" returned: 0 in 0.517s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:32 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c 1G Apr 25 02:17:32 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:32 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c 1G" returned: 0 in 0.583s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018a953a-bf76-4799-bb6e-b05d641bbe4a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:33 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018a953a-bf76-4799-bb6e-b05d641bbe4a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c Apr 25 02:17:33 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:33 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018a953a-bf76-4799-bb6e-b05d641bbe4a -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c" returned: 0 in 0.454s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:33 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c is being set with open permissions: ugo+rw Apr 25 02:17:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:33 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c Apr 25 02:17:33 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:33 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c" returned: 0 in 0.454s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:33 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.info Apr 25 02:17:33 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:34 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.info" returned: 0 in 0.454s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:34 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.info is being set with open permissions: ugo+rw Apr 25 02:17:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:34 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.info Apr 25 02:17:34 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:34 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.info" returned: 0 in 0.452s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:34 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b8a15204-97bd-49ec-8176-0ead24075b90 tempest-CinderUnicodeTest-507855702 None] Create snapshot completed successfully Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "cinder-4fd2be85-97a6-4891-9695-0dea59ef6b3c-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-4fd2be85-97a6-4891-9695-0dea59ef6b3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "cinder-quobyte-018a953a-bf76-4799-bb6e-b05d641bbe4a" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-quobyte-018a953a-bf76-4799-bb6e-b05d641bbe4a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "cinder-quobyte-4fd2be85-97a6-4891-9695-0dea59ef6b3c" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-quobyte-4fd2be85-97a6-4891-9695-0dea59ef6b3c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Deleting offline snapshot 4fd2be85-97a6-4891-9695-0dea59ef6b3c of volume 018a953a-bf76-4799-bb6e-b05d641bbe4a {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] snapshot_file for this snap is: volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe5f552-1600-441d-b6c5-40b6d06cdd42]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:35 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c Apr 25 02:17:35 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:35 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c" returned: 0 in 0.528s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-018a953a-bf76-4799-bb6e-b05d641bbe4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0699ce-2cc2-4871-af5a-197d5797dc96]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:35 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a Apr 25 02:17:35 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:36 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a" returned: 0 in 0.529s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:36 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c Apr 25 02:17:36 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:36 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c" returned: 0 in 0.537s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:36 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c Apr 25 02:17:36 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:37 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a.4fd2be85-97a6-4891-9695-0dea59ef6b3c" returned: 0 in 0.444s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-quobyte-4fd2be85-97a6-4891-9695-0dea59ef6b3c" released by "_delete_snapshot" :: held 2.134s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-quobyte-018a953a-bf76-4799-bb6e-b05d641bbe4a" released by "delete_snapshot" :: held 2.159s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:37 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Created reservations ['df0a52e4-9e80-4c91-ac97-ff12f8a232f2', '1dfb6c75-bc43-44b1-be68-eee092a31ef3', '84b32c65-f0d7-426e-802a-a8d6c30a4a6b', '3734de08-dc56-45dc-91d0-bf787aa91e95'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:17:37 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Delete snapshot completed successfully. Apr 25 02:17:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-6faffac5-8a5d-44cf-b050-b1db2a014399 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-4fd2be85-97a6-4891-9695-0dea59ef6b3c-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "cinder-018a953a-bf76-4799-bb6e-b05d641bbe4a-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-018a953a-bf76-4799-bb6e-b05d641bbe4a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "cinder-quobyte-018a953a-bf76-4799-bb6e-b05d641bbe4a" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-quobyte-018a953a-bf76-4799-bb6e-b05d641bbe4a" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:38 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9af2fe1-b121-4eb4-8c1d-cbcbd0ab6dda]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:38 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a Apr 25 02:17:38 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:38 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a" returned: 0 in 0.495s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:38 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a Apr 25 02:17:38 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:39 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-018a953a-bf76-4799-bb6e-b05d641bbe4a" returned: 0 in 0.433s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-quobyte-018a953a-bf76-4799-bb6e-b05d641bbe4a" released by "delete_volume" :: held 0.985s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Created reservations ['b996afd7-79b6-432d-b033-077966c6a777', '52621b08-d8c8-4c9f-ad9e-e077c99ea5c6', 'c56ddeb7-7ab7-4642-9dae-673afbae5ba8', 'b0bacb4f-811e-4f7d-89fc-719f5325edb8'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:39 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:17:39 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:39 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.437s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:17:39 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Deleted volume successfully. Apr 25 02:17:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-807e8da5-91cc-4c39-afc6-7c39b93abf05 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-018a953a-bf76-4799-bb6e-b05d641bbe4a-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "cinder-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "cinder-quobyte-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:17:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-quobyte-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:17:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[05847c34-c760-4311-9ada-fde1c385f41c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:17:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:40 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 Apr 25 02:17:40 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:41 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5" returned: 0 in 0.512s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:41 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5 Apr 25 02:17:41 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:41 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5" returned: 0 in 0.418s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-quobyte-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5" released by "delete_volume" :: held 0.969s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Created reservations ['37dcb3c5-b3cf-4f0d-9952-9a8e59a77248', '34dddc14-75b6-4b92-b1c7-552f73caefc8', 'a37e4e94-92b7-4b76-b1f0-7edfa6528b20', '5962340a-2f50-4101-949d-08ab968ad9f5'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:41 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:17:41 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:42 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:42 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.437s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:42 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:17:42 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Deleted volume successfully. Apr 25 02:17:42 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-20d401c3-5531-4ae8-bdbc-5bb22bca5d57 tempest-CinderUnicodeTest-507855702 None] Lock "cinder-1f7e45e7-ab6a-4b5a-88a6-c68773d027a5-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Flow 'volume_create_manager' (d44f0773-b580-4db1-87c2-794614421e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d2ae5a-a619-4085-9cb9-d3b543541219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d2ae5a-a619-4085-9cb9-d3b543541219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-710861069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e732dd01-85fa-4c20-b182-5c73697f6f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3818c5f85e40431f88a7400783efe122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:51Z,use_quota=True,user_id='bfc1e936317541f6aa9c7845914881ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3add4b6e-1216-4de1-bafe-8dbdae565e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3add4b6e-1216-4de1-bafe-8dbdae565e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4803f3a2-a485-4845-b8cf-55608071016e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4803f3a2-a485-4845-b8cf-55608071016e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e732dd01-85fa-4c20-b182-5c73697f6f12', 'volume_name': 'volume-e732dd01-85fa-4c20-b182-5c73697f6f12', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ffd380-e394-4f70-ade2-443d00f5de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ffd380-e394-4f70-ade2-443d00f5de76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b66dfc1-1b70-4c1d-9b6b-8f04fd10a63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Volume e732dd01-85fa-4c20-b182-5c73697f6f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e732dd01-85fa-4c20-b182-5c73697f6f12', 'volume_size': 1} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-710861069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e732dd01-85fa-4c20-b182-5c73697f6f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3818c5f85e40431f88a7400783efe122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:51Z,use_quota=True,user_id='bfc1e936317541f6aa9c7845914881ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Creating volume e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:51 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:51 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 1073741824 Apr 25 02:17:51 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (e1c953ec-50ce-4f0d-aaf6-0411c6a7428d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb96dace-b7a9-4b36-8c56-37e6d6f269c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb96dace-b7a9-4b36-8c56-37e6d6f269c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549420866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f47722-ca4a-406f-b359-87b61587c3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:51Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d918e274-3e1e-46c6-b853-eabc9bb57fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d918e274-3e1e-46c6-b853-eabc9bb57fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88f1f69-985a-486f-bbd5-6d3554c76b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88f1f69-985a-486f-bbd5-6d3554c76b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f47722-ca4a-406f-b359-87b61587c3c9', 'volume_name': 'volume-03f47722-ca4a-406f-b359-87b61587c3c9', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef6a873-b8ad-44e9-af6a-af2cd785c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef6a873-b8ad-44e9-af6a-af2cd785c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb6b7d2-07b4-4299-9683-ee51935081dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume 03f47722-ca4a-406f-b359-87b61587c3c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f47722-ca4a-406f-b359-87b61587c3c9', 'volume_size': 1} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (039f474e-3298-4c90-803a-63ee98f4ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcef3c7f-9bb9-43e9-b3c4-a84ee196ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcef3c7f-9bb9-43e9-b3c4-a84ee196ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1774360763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1ded92-62ed-4105-bdcd-eaaf50b2fb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:52Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621e066e-c8db-4cf9-b302-fc2d71c81c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621e066e-c8db-4cf9-b302-fc2d71c81c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bde28e-9f67-4e9f-a63f-f8d0de30ac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bde28e-9f67-4e9f-a63f-f8d0de30ac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1ded92-62ed-4105-bdcd-eaaf50b2fb77', 'volume_name': 'volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0752e587-b2f9-45ca-8125-91bf467c5b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0752e587-b2f9-45ca-8125-91bf467c5b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1876da-ff60-4708-8508-6b3eb03bb192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Volume 6b1ded92-62ed-4105-bdcd-eaaf50b2fb77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77', 'volume_size': 1} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (f8583635-0bc2-4d97-941f-182ad73ffcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acad5957-aa1b-4633-a96d-d13710c591b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acad5957-aa1b-4633-a96d-d13710c591b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107925001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9aea2be-4056-405c-bdd6-d487d6737574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:52Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00131ba3-9ceb-474d-b229-3205500c7a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00131ba3-9ceb-474d-b229-3205500c7a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030f6386-475a-4ed2-aefe-63fc72259593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:51 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030f6386-475a-4ed2-aefe-63fc72259593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9aea2be-4056-405c-bdd6-d487d6737574', 'volume_name': 'volume-b9aea2be-4056-405c-bdd6-d487d6737574', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdde6a0-b7d8-4025-8cf0-f84c171b6222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcdde6a0-b7d8-4025-8cf0-f84c171b6222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f075a408-8784-4a3d-a508-e3a0088f8cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Volume b9aea2be-4056-405c-bdd6-d487d6737574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9aea2be-4056-405c-bdd6-d487d6737574', 'volume_size': 1} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 1073741824" returned: 0 in 0.808s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:52 devstack sudo[90523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 Apr 25 02:17:52 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (aa689ab7-620c-4fa1-8fe6-4c5634b68996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae84cc6-8786-4bb4-881c-d57b65ac1df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae84cc6-8786-4bb4-881c-d57b65ac1df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439447605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:52Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acb4b35-52a5-468d-acb0-fd74f7ab653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2acb4b35-52a5-468d-acb0-fd74f7ab653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1de9536-16f4-4180-aeec-6c99c2a672b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1de9536-16f4-4180-aeec-6c99c2a672b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c', 'volume_name': 'volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33a45e4-2c51-4c7d-a3c0-a944578f7874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33a45e4-2c51-4c7d-a3c0-a944578f7874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de6ffec-48ba-49f2-8308-abe8f12057de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Volume 7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c', 'volume_size': 1} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (ed148513-29ca-4010-a1ec-04d44adee1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c70430-2693-41d9-847e-3cd174490317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c70430-2693-41d9-847e-3cd174490317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2004249757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082583ed-b904-46cb-b787-9077cc7be05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:53Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3596c4e-dffe-49bf-adc2-f8f4e9153c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3596c4e-dffe-49bf-adc2-f8f4e9153c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b669cda-5e99-4834-a544-0489786a04a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b669cda-5e99-4834-a544-0489786a04a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082583ed-b904-46cb-b787-9077cc7be05c', 'volume_name': 'volume-082583ed-b904-46cb-b787-9077cc7be05c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a550c5-ba8c-424c-9d28-5d9a57ae67db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a550c5-ba8c-424c-9d28-5d9a57ae67db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c9d663-b4a1-45d8-9b0e-1feeaf2deea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Volume 082583ed-b904-46cb-b787-9077cc7be05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082583ed-b904-46cb-b787-9077cc7be05c', 'volume_size': 1} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:52 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12" returned: 0 in 0.655s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549420866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f47722-ca4a-406f-b359-87b61587c3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:51Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Creating volume 03f47722-ca4a-406f-b359-87b61587c3c9 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:52 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b66dfc1-1b70-4c1d-9b6b-8f04fd10a63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e732dd01-85fa-4c20-b182-5c73697f6f12', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043b5439-19a9-4a71-80a9-88bf47eed85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 1073741824 Apr 25 02:17:52 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:52 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Volume volume-e732dd01-85fa-4c20-b182-5c73697f6f12 (e732dd01-85fa-4c20-b182-5c73697f6f12): created successfully Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043b5439-19a9-4a71-80a9-88bf47eed85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Flow 'volume_create_manager' (d44f0773-b580-4db1-87c2-794614421e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:52 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b8138d37-e78c-4342-831e-27f191e57970 tempest-VolumeDependencyTests-1519311421 None] Created volume successfully. Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (78f72f24-7e58-44b3-a2d2-2a3badb998ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415febda-39d0-4ff1-8ceb-2d4e9d3ca1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415febda-39d0-4ff1-8ceb-2d4e9d3ca1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-499636901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7962a6-fe01-428e-9a5e-36014ee6c94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:53Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe5ba67-5f6f-4b69-aac9-5a1fd4e6b8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe5ba67-5f6f-4b69-aac9-5a1fd4e6b8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bebd0f-be40-497e-9da7-335c338ce8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:52 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20bebd0f-be40-497e-9da7-335c338ce8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7962a6-fe01-428e-9a5e-36014ee6c94b', 'volume_name': 'volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d79f2ab-0dd2-4be3-8515-1710677563b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d79f2ab-0dd2-4be3-8515-1710677563b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:53 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4ee76c-784d-4736-84a8-85ceb7d0b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:53 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Volume fb7962a6-fe01-428e-9a5e-36014ee6c94b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b', 'volume_size': 1} Apr 25 02:17:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:53 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 1073741824" returned: 0 in 0.784s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:53 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 Apr 25 02:17:53 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:54 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9" returned: 0 in 0.458s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.365s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1774360763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1ded92-62ed-4105-bdcd-eaaf50b2fb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:52Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Creating volume 6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:54 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb6b7d2-07b4-4299-9683-ee51935081dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f47722-ca4a-406f-b359-87b61587c3c9', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:54 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 1073741824 Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f50c89b-4186-4cae-bc0e-b7ad866a23cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:54 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:54 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume volume-03f47722-ca4a-406f-b359-87b61587c3c9 (03f47722-ca4a-406f-b359-87b61587c3c9): created successfully Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f50c89b-4186-4cae-bc0e-b7ad866a23cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (e1c953ec-50ce-4f0d-aaf6-0411c6a7428d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:54 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-90d04a1a-d023-461f-a0e6-9e4108ab7647 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created volume successfully. Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:54 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 1073741824" returned: 0 in 0.775s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:54 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 Apr 25 02:17:54 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:55 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77" returned: 0 in 0.473s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.304s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107925001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9aea2be-4056-405c-bdd6-d487d6737574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:52Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Creating volume b9aea2be-4056-405c-bdd6-d487d6737574 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:55 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:55 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574 1073741824 Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1876da-ff60-4708-8508-6b3eb03bb192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:55 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488ab9cc-0233-4f8e-9616-2c0011b05e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:55 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Volume volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 (6b1ded92-62ed-4105-bdcd-eaaf50b2fb77): created successfully Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488ab9cc-0233-4f8e-9616-2c0011b05e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:55 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (039f474e-3298-4c90-803a-63ee98f4ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:55 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-39edb737-a13c-48ed-96d0-8746c9957496 tempest-CreateVolumesFromImageTest-2111855420 None] Created volume successfully. Apr 25 02:17:56 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574 1073741824" returned: 0 in 0.751s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:56 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574 Apr 25 02:17:56 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:56 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574" returned: 0 in 0.441s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.192s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439447605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:52Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Creating volume 7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:56 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:56 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c 1073741824 Apr 25 02:17:56 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f075a408-8784-4a3d-a508-e3a0088f8cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9aea2be-4056-405c-bdd6-d487d6737574', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f15ad1-5a4d-48e5-8f72-037bda72318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:56 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Volume volume-b9aea2be-4056-405c-bdd6-d487d6737574 (b9aea2be-4056-405c-bdd6-d487d6737574): created successfully Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f15ad1-5a4d-48e5-8f72-037bda72318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:56 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (f8583635-0bc2-4d97-941f-182ad73ffcfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:56 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-60774181-184c-41cc-80b3-0a3c9eee5792 tempest-CreateVolumesFromImageTest-2111855420 None] Created volume successfully. Apr 25 02:17:57 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c 1073741824" returned: 0 in 0.666s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:57 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c Apr 25 02:17:57 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:57 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c" returned: 0 in 0.457s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.083s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2004249757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082583ed-b904-46cb-b787-9077cc7be05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:53Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Creating volume 082583ed-b904-46cb-b787-9077cc7be05c {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:57 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de6ffec-48ba-49f2-8308-abe8f12057de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:57 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c 1073741824 Apr 25 02:17:57 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28dba9b-4743-40ca-bfcf-e794b2ec1ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:57 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Volume volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c (7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c): created successfully Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28dba9b-4743-40ca-bfcf-e794b2ec1ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (aa689ab7-620c-4fa1-8fe6-4c5634b68996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:57 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-4c9486c6-3066-4bb6-b5df-6aa71ec90c35 tempest-CreateVolumesFromImageTest-2111855420 None] Created volume successfully. Apr 25 02:17:58 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c 1073741824" returned: 0 in 0.698s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:58 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c Apr 25 02:17:58 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:59 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c" returned: 0 in 0.544s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.013s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-499636901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7962a6-fe01-428e-9a5e-36014ee6c94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3174d3dea2c34411b9523ddcf8f77ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:17:53Z,use_quota=True,user_id='90f1b3032c294c5da85bfc0038120b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Creating volume fb7962a6-fe01-428e-9a5e-36014ee6c94b {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:17:59 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c9d663-b4a1-45d8-9b0e-1feeaf2deea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082583ed-b904-46cb-b787-9077cc7be05c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:59 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b 1073741824 Apr 25 02:17:59 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b0567c-9195-4aad-ace9-df263d0aa03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:17:59 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Volume volume-082583ed-b904-46cb-b787-9077cc7be05c (082583ed-b904-46cb-b787-9077cc7be05c): created successfully Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b0567c-9195-4aad-ace9-df263d0aa03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (ed148513-29ca-4010-a1ec-04d44adee1e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:17:59 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c585e3b0-f999-4820-8ae6-a58ff01c1ce6 tempest-CreateVolumesFromImageTest-2111855420 None] Created volume successfully. Apr 25 02:17:59 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b 1073741824" returned: 0 in 0.675s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:17:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:17:59 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b Apr 25 02:17:59 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:00 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b" returned: 0 in 0.497s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.792s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Creating offline snapshot 5d143041-faaa-4b1e-bd4d-68e6cfe4e955 of volume e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d4ee76c-784d-4736-84a8-85ceb7d0b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9eb603b-1bc0-430a-a277-8f3396af7212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc57a50-6b8a-402e-a103-0a6f2d829c8a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:00 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Volume volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b (fb7962a6-fe01-428e-9a5e-36014ee6c94b): created successfully Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9eb603b-1bc0-430a-a277-8f3396af7212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Flow 'volume_create_manager' (78f72f24-7e58-44b3-a2d2-2a3badb998ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:00 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-686fceae-c4c3-42ec-a3d7-889b5cae49a9 tempest-CreateVolumesFromImageTest-2111855420 None] Created volume successfully. Apr 25 02:18:00 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 Apr 25 02:18:00 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-fb7962a6-fe01-428e-9a5e-36014ee6c94b-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-fb7962a6-fe01-428e-9a5e-36014ee6c94b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-quobyte-fb7962a6-fe01-428e-9a5e-36014ee6c94b" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-fb7962a6-fe01-428e-9a5e-36014ee6c94b" acquired by "delete_volume" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da1e6d-ba5b-4315-ab22-537047fc2d91]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:00 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b Apr 25 02:18:00 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:01 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12" returned: 0 in 0.772s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:01 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 1G Apr 25 02:18:01 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:01 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b" returned: 0 in 0.628s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:01 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b Apr 25 02:18:01 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:01 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 1G" returned: 0 in 0.782s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e732dd01-85fa-4c20-b182-5c73697f6f12 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:01 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e732dd01-85fa-4c20-b182-5c73697f6f12 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 Apr 25 02:18:01 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:02 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fb7962a6-fe01-428e-9a5e-36014ee6c94b" returned: 0 in 0.592s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-fb7962a6-fe01-428e-9a5e-36014ee6c94b" released by "delete_volume" :: held 1.261s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Created reservations ['f01b1109-9c88-4b0e-9094-01d517ad526b', 'fde58e5f-e10a-4b00-beb0-dadbf07f3aa5', '33eae6e3-2d4e-4883-846c-5a7986c22238', 'fda25a20-ae94-42f6-9780-abe67b9b6502'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:02 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:02 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:02 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e732dd01-85fa-4c20-b182-5c73697f6f12 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955" returned: 0 in 0.534s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:02 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 is being set with open permissions: ugo+rw Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:02 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 Apr 25 02:18:02 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:02 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.506s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Deleted volume successfully. Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-86da580f-bf27-46e4-8138-f396ad6dfa16 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-fb7962a6-fe01-428e-9a5e-36014ee6c94b-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:02 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955" returned: 0 in 0.549s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-082583ed-b904-46cb-b787-9077cc7be05c-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:03 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.info Apr 25 02:18:03 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-082583ed-b904-46cb-b787-9077cc7be05c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-quobyte-082583ed-b904-46cb-b787-9077cc7be05c" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-082583ed-b904-46cb-b787-9077cc7be05c" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d63d8ea-ade6-4ac4-8c51-c386cb1fd361]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:03 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c Apr 25 02:18:03 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:03 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.info" returned: 0 in 0.517s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:03 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.info is being set with open permissions: ugo+rw Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:03 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.info Apr 25 02:18:03 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:03 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c" returned: 0 in 0.620s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:03 devstack sudo[90614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c Apr 25 02:18:03 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:04 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.info" returned: 0 in 0.548s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.806s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.486s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c4b0641d-7067-47bc-912b-78f4fcf90cdd tempest-VolumeDependencyTests-1519311421 None] Create snapshot completed successfully Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Creating offline snapshot 3137b1df-b4e2-4611-8240-4040ca4f51fe of volume 03f47722-ca4a-406f-b359-87b61587c3c9 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eed948-aea1-491a-a2a2-650cbba6150a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:04 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 Apr 25 02:18:04 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:04 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-082583ed-b904-46cb-b787-9077cc7be05c" returned: 0 in 0.505s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-082583ed-b904-46cb-b787-9077cc7be05c" released by "delete_volume" :: held 1.167s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Created reservations ['276ed369-2fcb-46e1-b191-8284a531c314', '3302f517-eb3c-4bbf-b271-0fce50d64ac3', '640bfad9-6f10-4391-9a4b-433e1486fa68', 'f09a9e08-f83e-42bf-bab1-42f4173d4837'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:04 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:04 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:04 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9" returned: 0 in 0.626s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:04 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe 1G Apr 25 02:18:04 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:04 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.489s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Deleted volume successfully. Apr 25 02:18:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-28f0aebf-4b57-44e2-96d2-5ca8b6016977 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-082583ed-b904-46cb-b787-9077cc7be05c-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-quobyte-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dbb3f2-9771-455f-8a22-a80d78c07dea]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Flow 'volume_create_manager' (597fbeae-3900-4755-82cc-f92701fd3b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:05 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225198ac-782f-4d3d-89c7-fbf2fab383e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:05 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225198ac-782f-4d3d-89c7-fbf2fab383e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1725429440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d41658-149c-4329-bbd0-daa84c5b02cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3818c5f85e40431f88a7400783efe122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5d143041-faaa-4b1e-bd4d-68e6cfe4e955,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:05Z,use_quota=True,user_id='bfc1e936317541f6aa9c7845914881ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:05 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbdde05-aeaa-46a7-afa0-a1c20ecade23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbdde05-aeaa-46a7-afa0-a1c20ecade23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab36c65-13af-42b6-8a07-aa815bf1ee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab36c65-13af-42b6-8a07-aa815bf1ee63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38d41658-149c-4329-bbd0-daa84c5b02cf', 'volume_name': 'volume-38d41658-149c-4329-bbd0-daa84c5b02cf', 'volume_size': 1, 'snapshot_id': '5d143041-faaa-4b1e-bd4d-68e6cfe4e955'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ca6e8d-2726-4232-bcac-6255c649faa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ca6e8d-2726-4232-bcac-6255c649faa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c64bb1-8f8e-40f4-9b46-402153a6509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:05 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Volume 38d41658-149c-4329-bbd0-daa84c5b02cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38d41658-149c-4329-bbd0-daa84c5b02cf', 'volume_size': 1, 'snapshot_id': '5d143041-faaa-4b1e-bd4d-68e6cfe4e955'} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe 1G" returned: 0 in 0.847s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03f47722-ca4a-406f-b359-87b61587c3c9 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:05 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03f47722-ca4a-406f-b359-87b61587c3c9 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe Apr 25 02:18:05 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:06 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c" returned: 0 in 0.694s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:06 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c Apr 25 02:18:06 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:06 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03f47722-ca4a-406f-b359-87b61587c3c9 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe" returned: 0 in 0.572s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:06 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe is being set with open permissions: ugo+rw Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:06 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe Apr 25 02:18:06 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:06 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c" returned: 0 in 0.595s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c" released by "delete_volume" :: held 1.358s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:06 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Created reservations ['402416d8-1e57-4391-a69c-22779b101871', '72011b05-24e9-436d-8e86-4602e3e9d2ec', '2d83602d-e267-4f72-ac6e-bd3307502261', '5625efc0-0c75-484e-9b5d-d2e638416407'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe" returned: 0 in 0.622s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:06 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:06 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:06 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.info Apr 25 02:18:06 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-b9aea2be-4056-405c-bdd6-d487d6737574-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-b9aea2be-4056-405c-bdd6-d487d6737574-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:07 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.845s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:07 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Deleted volume successfully. Apr 25 02:18:07 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.info" returned: 0 in 0.858s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:07 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.info is being set with open permissions: ugo+rw Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-quobyte-b9aea2be-4056-405c-bdd6-d487d6737574" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1a59b13b-3011-44a2-9242-f14c45e8e19a tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-7ebf8487-d05d-4e7e-a53a-0083ca6a0f7c-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:07 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.info Apr 25 02:18:07 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-b9aea2be-4056-405c-bdd6-d487d6737574" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d31e81a-cf84-406b-91a2-f7d1a6333811]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:07 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574 Apr 25 02:18:07 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:08 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.info" returned: 0 in 0.614s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.325s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.793s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-5d143041-faaa-4b1e-bd4d-68e6cfe4e955-38d41658-149c-4329-bbd0-daa84c5b02cf" by "_create_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:08 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-64a2a253-1bb6-4ee2-8d4c-7ea03d03d35a tempest-CreateVolumesFromSnapshotTest-337969400 None] Create snapshot completed successfully Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-5d143041-faaa-4b1e-bd4d-68e6cfe4e955-38d41658-149c-4329-bbd0-daa84c5b02cf" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Creating volume 38d41658-149c-4329-bbd0-daa84c5b02cf from snapshot 5d143041-faaa-4b1e-bd4d-68e6cfe4e955 {{(pid=81927) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-38d41658-149c-4329-bbd0-daa84c5b02cf" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-38d41658-149c-4329-bbd0-daa84c5b02cf" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] snapshot: 5d143041-faaa-4b1e-bd4d-68e6cfe4e955, volume: 38d41658-149c-4329-bbd0-daa84c5b02cf, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:08 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574" returned: 0 in 0.695s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cc2e3f-64a7-41c8-bd5f-2083250b0050]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:08 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574 Apr 25 02:18:08 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:08 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 Apr 25 02:18:08 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:09 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b9aea2be-4056-405c-bdd6-d487d6737574" returned: 0 in 0.492s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-b9aea2be-4056-405c-bdd6-d487d6737574" released by "delete_volume" :: held 1.248s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Created reservations ['aa90fe5d-81a2-466d-9de6-7338b82c8486', '3dcb9f51-1309-4760-93ae-0251676219fd', '8bcd6b11-b2f2-4c63-b24d-ffdd87c3104b', 'd2d89a52-9bbe-4e60-ba38-2554ca0f34f8'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:09 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:09 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:09 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955" returned: 0 in 0.637s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e732dd01-85fa-4c20-b182-5c73697f6f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01f0836-d592-441f-90d9-f6bd3e110f74]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:09 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 Apr 25 02:18:09 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (0a98be16-260d-423d-a3aa-0937678a3c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2aa67d2-8de7-4da1-aab5-94b76e24b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2aa67d2-8de7-4da1-aab5-94b76e24b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545727116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7302f4bc-72f8-4b67-b477-3f0c761d690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:10Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6be23a-c4eb-40ae-be82-ee56b515290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6be23a-c4eb-40ae-be82-ee56b515290f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8d0785-3258-41c7-946f-4f7535f1488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8d0785-3258-41c7-946f-4f7535f1488f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7302f4bc-72f8-4b67-b477-3f0c761d690a', 'volume_name': 'volume-7302f4bc-72f8-4b67-b477-3f0c761d690a', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57be92f4-3708-4052-ba11-29372b10f963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57be92f4-3708-4052-ba11-29372b10f963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7390e50-88d1-474f-a2f9-0538c542f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:09 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume 7302f4bc-72f8-4b67-b477-3f0c761d690a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7302f4bc-72f8-4b67-b477-3f0c761d690a', 'volume_size': 1} Apr 25 02:18:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:09 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.839s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:10 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Deleted volume successfully. Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (d037d95c-c0b0-45ab-8e4c-0cd93fb0c2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef22276-b872-40ec-ba31-c7ceb12420bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef22276-b872-40ec-ba31-c7ceb12420bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1138940743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d64cdf-2162-4f13-9720-9e2df52efb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:10Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938211bb-9237-4f90-b016-7466809add24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938211bb-9237-4f90-b016-7466809add24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc94b7c6-fbb4-4352-9026-08f2ec881cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc94b7c6-fbb4-4352-9026-08f2ec881cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d64cdf-2162-4f13-9720-9e2df52efb5b', 'volume_name': 'volume-81d64cdf-2162-4f13-9720-9e2df52efb5b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da11a46-b769-4b3b-b825-1ff6d2b1bfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da11a46-b769-4b3b-b825-1ff6d2b1bfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c6fe2b-b303-46b6-b411-c08745c4255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume 81d64cdf-2162-4f13-9720-9e2df52efb5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d64cdf-2162-4f13-9720-9e2df52efb5b', 'volume_size': 1} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-5fd2ecc3-5afc-43a9-b6e4-e490fb3cb693 tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-b9aea2be-4056-405c-bdd6-d487d6737574-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "cinder-quobyte-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:10 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12" returned: 0 in 1.094s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a81680e-5c80-422f-9a2e-5114e51363c4]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:10 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf Apr 25 02:18:10 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:10 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 Apr 25 02:18:10 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (80c59b31-782f-4c3f-b36a-5c79bf61f631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7060aa1-424e-4150-be30-50d5ff1180a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7060aa1-424e-4150-be30-50d5ff1180a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1788401833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63a1d77-f281-4224-a5fc-c484a60340e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:10Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fdb1b3-f0ef-43fb-8c2c-64b412673f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18fdb1b3-f0ef-43fb-8c2c-64b412673f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f6614-69ba-4de7-9d6c-5d9293e29e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87f6614-69ba-4de7-9d6c-5d9293e29e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f63a1d77-f281-4224-a5fc-c484a60340e0', 'volume_name': 'volume-f63a1d77-f281-4224-a5fc-c484a60340e0', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318ba375-2a0a-4c82-93e6-f1fa95d830a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318ba375-2a0a-4c82-93e6-f1fa95d830a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e780cc5d-3542-43f7-a3bc-c69a05ea03ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume f63a1d77-f281-4224-a5fc-c484a60340e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f63a1d77-f281-4224-a5fc-c484a60340e0', 'volume_size': 1} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (a67c0b27-b255-449b-88c6-b969e8d0117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c55cc0-9c23-4bf9-89e1-ee40b70763fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c55cc0-9c23-4bf9-89e1-ee40b70763fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220009363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4b0194-4aa3-443e-a729-c9f60c368abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:11Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c963819-423c-41aa-aab1-ad1998b21243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c963819-423c-41aa-aab1-ad1998b21243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac814f06-ad6c-4825-a103-e9cbd605c409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac814f06-ad6c-4825-a103-e9cbd605c409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e4b0194-4aa3-443e-a729-c9f60c368abd', 'volume_name': 'volume-7e4b0194-4aa3-443e-a729-c9f60c368abd', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a78248-dbec-434d-8c51-9f5a447dcd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a78248-dbec-434d-8c51-9f5a447dcd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dea586d-bf19-4fa6-9828-806205c6d068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:10 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume 7e4b0194-4aa3-443e-a729-c9f60c368abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e4b0194-4aa3-443e-a729-c9f60c368abd', 'volume_size': 1} Apr 25 02:18:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (331c18c5-02e1-479f-b4e2-b8638bd5c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc37a99c-2a92-4305-abfe-e6d039c20d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:11 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:11 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:11 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc37a99c-2a92-4305-abfe-e6d039c20d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889258999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0def201e-9d97-4def-a4d0-87e00287dc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:11Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfab1af-8695-460e-bb81-a4c3826b8fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfab1af-8695-460e-bb81-a4c3826b8fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a11104d-472b-4c67-b7bb-2b94c6ebaaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a11104d-472b-4c67-b7bb-2b94c6ebaaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0def201e-9d97-4def-a4d0-87e00287dc56', 'volume_name': 'volume-0def201e-9d97-4def-a4d0-87e00287dc56', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f2b98b-0f92-4034-bb41-171ee5b58160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f2b98b-0f92-4034-bb41-171ee5b58160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd4a6dd-5c99-422c-b896-46553c411948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume 0def201e-9d97-4def-a4d0-87e00287dc56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0def201e-9d97-4def-a4d0-87e00287dc56', 'volume_size': 1} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77" returned: 0 in 0.959s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:11 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77 Apr 25 02:18:11 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Flow 'volume_create_manager' (4c87f01d-d652-45a2-a227-e9063c52eeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa79b9d-f111-4b9f-a02d-d3ddfebb6092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa79b9d-f111-4b9f-a02d-d3ddfebb6092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-582138415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54768d-5bae-49c2-b204-8cda0601ffa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396285c3817a4aa3917355df3cf7e590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:11Z,use_quota=True,user_id='2adaa3961f3843718f22ad97b5b5dab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d26875-1cc6-4e0c-b459-8438446cfbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d26875-1cc6-4e0c-b459-8438446cfbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0039f7-752c-41e9-ba64-dec998245fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0039f7-752c-41e9-ba64-dec998245fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd54768d-5bae-49c2-b204-8cda0601ffa0', 'volume_name': 'volume-cd54768d-5bae-49c2-b204-8cda0601ffa0', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a431e22-7354-4bdd-9b82-1e61658480c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a431e22-7354-4bdd-9b82-1e61658480c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0683645e-a194-4a84-85f7-c52e0d383cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:11 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Volume cd54768d-5bae-49c2-b204-8cda0601ffa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd54768d-5bae-49c2-b204-8cda0601ffa0', 'volume_size': 1} Apr 25 02:18:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:12 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77" returned: 0 in 0.888s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-quobyte-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77" released by "delete_volume" :: held 1.933s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:12 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.217s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Created reservations ['dfaf42f5-a021-4b11-af36-e5877c21ea83', 'd70b3cf6-d316-4241-a5a3-f02f33d3b4ea', '5963a19b-8d1d-4a21-b46e-6d1639048bdc', 'fd1fa05f-08e5-4cef-9417-4ac7be4e6ef5'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:12 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:12 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:13 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.272s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:13 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:13 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Deleted volume successfully. Apr 25 02:18:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1ddad53e-dc77-429f-8eb6-3808947a6bcd tempest-CreateVolumesFromImageTest-2111855420 None] Lock "cinder-6b1ded92-62ed-4105-bdcd-eaaf50b2fb77-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:16 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf" returned: 0 in 5.992s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:16 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dd73f5-1499-4353-b557-d2d12f004b09]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:16 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 Apr 25 02:18:16 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:16 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:16 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12" returned: 0 in 0.664s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:16 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:18:16 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Converted 1024.00 MB image at 170.86 MB/s Apr 25 02:18:16 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf is being set with open permissions: ugo+rw Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:17 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf Apr 25 02:18:17 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (581937f0-85eb-450e-bb27-96c4c719bde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb5e333-cb8c-40ba-b3a0-30712613c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:17 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf" returned: 0 in 0.472s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb5e333-cb8c-40ba-b3a0-30712613c403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-681492781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69433dd0-0395-44e6-9eb1-d05bb9bdec3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:17Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126b2b34-1fdb-4012-bb1d-44c9d5222f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126b2b34-1fdb-4012-bb1d-44c9d5222f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeecf6e-8508-4d9f-a164-1a0ec7bc60a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aeecf6e-8508-4d9f-a164-1a0ec7bc60a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69433dd0-0395-44e6-9eb1-d05bb9bdec3e', 'volume_name': 'volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c503cbc-87b4-4dd2-a5ce-d476084c92f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c503cbc-87b4-4dd2-a5ce-d476084c92f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312a172b-1cbb-4363-b8df-987a554bf784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:17 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume 69433dd0-0395-44e6-9eb1-d05bb9bdec3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e', 'volume_size': 1} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-38d41658-149c-4329-bbd0-daa84c5b02cf" released by "_copy_volume_from_snapshot" :: held 9.028s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-5d143041-faaa-4b1e-bd4d-68e6cfe4e955-38d41658-149c-4329-bbd0-daa84c5b02cf" released by "_create_volume_from_snapshot" :: held 9.079s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.115s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.687s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1545727116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7302f4bc-72f8-4b67-b477-3f0c761d690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:10Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Creating volume 7302f4bc-72f8-4b67-b477-3f0c761d690a {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:17 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:17 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a 1073741824 Apr 25 02:18:17 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c64bb1-8f8e-40f4-9b46-402153a6509c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d41658-149c-4329-bbd0-daa84c5b02cf', 'volume_size': 1, 'snapshot_id': '5d143041-faaa-4b1e-bd4d-68e6cfe4e955'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accca4a0-7413-4c19-8b99-30a1bba0e3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:17 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Volume volume-38d41658-149c-4329-bbd0-daa84c5b02cf (38d41658-149c-4329-bbd0-daa84c5b02cf): created successfully Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accca4a0-7413-4c19-8b99-30a1bba0e3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:17 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Flow 'volume_create_manager' (597fbeae-3900-4755-82cc-f92701fd3b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:17 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b93978a8-7929-4613-b387-44f6cc0a7e83 tempest-VolumeDependencyTests-1519311421 None] Created volume successfully. Apr 25 02:18:18 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a 1073741824" returned: 0 in 0.613s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:18 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a Apr 25 02:18:18 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:18 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a" returned: 0 in 0.436s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.386s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1138940743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d64cdf-2162-4f13-9720-9e2df52efb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:10Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Creating volume 81d64cdf-2162-4f13-9720-9e2df52efb5b {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:18 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:18 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b 1073741824 Apr 25 02:18:18 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7390e50-88d1-474f-a2f9-0538c542f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7302f4bc-72f8-4b67-b477-3f0c761d690a', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca6d767-1124-46c4-a6df-e955590b2ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:18 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume volume-7302f4bc-72f8-4b67-b477-3f0c761d690a (7302f4bc-72f8-4b67-b477-3f0c761d690a): created successfully Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca6d767-1124-46c4-a6df-e955590b2ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (0a98be16-260d-423d-a3aa-0937678a3c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:18 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0c94141f-747b-4c17-b2da-33790ae731fe tempest-CreateVolumesFromSnapshotTest-337969400 None] Created volume successfully. Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-5d143041-faaa-4b1e-bd4d-68e6cfe4e955-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-5d143041-faaa-4b1e-bd4d-68e6cfe4e955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-e732dd01-85fa-4c20-b182-5c73697f6f12" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-e732dd01-85fa-4c20-b182-5c73697f6f12" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-5d143041-faaa-4b1e-bd4d-68e6cfe4e955" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-5d143041-faaa-4b1e-bd4d-68e6cfe4e955" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Deleting offline snapshot 5d143041-faaa-4b1e-bd4d-68e6cfe4e955 of volume e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] snapshot_file for this snap is: volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4161a2-920c-422e-be41-080db2c3fa80]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:18 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:18 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 Apr 25 02:18:18 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:19 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b 1073741824" returned: 0 in 0.594s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:19 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b Apr 25 02:18:19 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:19 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955" returned: 0 in 0.560s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e732dd01-85fa-4c20-b182-5c73697f6f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd93cef-1b15-417e-b916-60802ddc182c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:19 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 Apr 25 02:18:19 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:19 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b" returned: 0 in 0.495s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.170s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1788401833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63a1d77-f281-4224-a5fc-c484a60340e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:10Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Creating volume f63a1d77-f281-4224-a5fc-c484a60340e0 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:19 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c6fe2b-b303-46b6-b411-c08745c4255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d64cdf-2162-4f13-9720-9e2df52efb5b', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:19 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0 1073741824 Apr 25 02:18:19 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a62227-4128-48ab-99ea-6812c0e2d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:19 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume volume-81d64cdf-2162-4f13-9720-9e2df52efb5b (81d64cdf-2162-4f13-9720-9e2df52efb5b): created successfully Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89a62227-4128-48ab-99ea-6812c0e2d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (d037d95c-c0b0-45ab-8e4c-0cd93fb0c2d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:19 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-54cd7a2a-1416-468c-8f44-1a8ce2a12577 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created volume successfully. Apr 25 02:18:19 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12" returned: 0 in 0.530s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:19 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:20 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 Apr 25 02:18:20 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:20 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0 1073741824" returned: 0 in 0.666s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:20 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0 Apr 25 02:18:20 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:20 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955" returned: 0 in 0.555s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:20 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955 Apr 25 02:18:20 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:20 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0" returned: 0 in 0.469s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.073s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220009363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4b0194-4aa3-443e-a729-c9f60c368abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:11Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Creating volume 7e4b0194-4aa3-443e-a729-c9f60c368abd {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:20 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:20 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd 1073741824 Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e780cc5d-3542-43f7-a3bc-c69a05ea03ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63a1d77-f281-4224-a5fc-c484a60340e0', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:20 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b4fb16-fb90-4d44-ba47-6492504cb12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:20 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:20 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12.5d143041-faaa-4b1e-bd4d-68e6cfe4e955" returned: 0 in 0.455s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:20 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume volume-f63a1d77-f281-4224-a5fc-c484a60340e0 (f63a1d77-f281-4224-a5fc-c484a60340e0): created successfully Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b4fb16-fb90-4d44-ba47-6492504cb12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (80c59b31-782f-4c3f-b36a-5c79bf61f631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c6be3ac6-3bbd-46bc-a7b0-1859ebfc8700 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created volume successfully. Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-5d143041-faaa-4b1e-bd4d-68e6cfe4e955" released by "_delete_snapshot" :: held 2.206s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-e732dd01-85fa-4c20-b182-5c73697f6f12" released by "delete_snapshot" :: held 2.228s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Created reservations ['13c22139-be26-45b0-b3d9-b3efd404693e', '3a7afa54-83fd-41c1-aeeb-f13e67b4326a', '5e247253-914a-41e1-bb7d-025d9c74bcfc', 'df685446-a6fb-408d-84a4-08ef903d20b7'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:21 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Delete snapshot completed successfully. Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-06c73b13-11c2-4726-9457-5413348f9e3c tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-5d143041-faaa-4b1e-bd4d-68e6cfe4e955-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:21 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd 1073741824" returned: 0 in 0.638s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:21 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd Apr 25 02:18:21 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-e732dd01-85fa-4c20-b182-5c73697f6f12-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:21 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-e732dd01-85fa-4c20-b182-5c73697f6f12-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-e732dd01-85fa-4c20-b182-5c73697f6f12" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-e732dd01-85fa-4c20-b182-5c73697f6f12" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7861c05-4c10-44f5-9fb5-2349da9d687a]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:22 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd" returned: 0 in 0.500s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.828s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889258999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0def201e-9d97-4def-a4d0-87e00287dc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b32648aca134a798a88d5694d917a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:11Z,use_quota=True,user_id='ed8a29d005124344a41124a98b73ba99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Creating volume 0def201e-9d97-4def-a4d0-87e00287dc56 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:22 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dea586d-bf19-4fa6-9828-806205c6d068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4b0194-4aa3-443e-a729-c9f60c368abd', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:22 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56 1073741824 Apr 25 02:18:22 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfb36e3-b4fb-4c2f-bd13-f053821db0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:22 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume volume-7e4b0194-4aa3-443e-a729-c9f60c368abd (7e4b0194-4aa3-443e-a729-c9f60c368abd): created successfully Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cfb36e3-b4fb-4c2f-bd13-f053821db0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (a67c0b27-b255-449b-88c6-b969e8d0117d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:22 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 Apr 25 02:18:22 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:22 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-86d0e482-b536-4398-97bd-0408a7c720e5 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created volume successfully. Apr 25 02:18:22 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12" returned: 0 in 0.566s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:22 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12 Apr 25 02:18:22 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:22 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56 1073741824" returned: 0 in 0.616s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:22 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:22 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56 Apr 25 02:18:22 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:23 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-e732dd01-85fa-4c20-b182-5c73697f6f12" returned: 0 in 0.467s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-e732dd01-85fa-4c20-b182-5c73697f6f12" released by "delete_volume" :: held 1.100s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Created reservations ['bcbce588-0e52-4f06-9a2f-49c0292b6240', '3562b04a-a89e-4527-96ef-cb9f688c61c1', 'b647dd18-30f2-4b6b-a864-d920ca21a6b2', '0e0b1170-4f0a-40b5-8282-36f470717b9c'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:23 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56" returned: 0 in 0.482s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.563s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-582138415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54768d-5bae-49c2-b204-8cda0601ffa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396285c3817a4aa3917355df3cf7e590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:11Z,use_quota=True,user_id='2adaa3961f3843718f22ad97b5b5dab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Creating volume cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:23 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:23 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:23 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd4a6dd-5c99-422c-b896-46553c411948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0def201e-9d97-4def-a4d0-87e00287dc56', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:23 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 1073741824 Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c1223e-6cf9-4bd6-802c-ade60367431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:23 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:23 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Volume volume-0def201e-9d97-4def-a4d0-87e00287dc56 (0def201e-9d97-4def-a4d0-87e00287dc56): created successfully Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c1223e-6cf9-4bd6-802c-ade60367431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Flow 'volume_create_manager' (331c18c5-02e1-479f-b4e2-b8638bd5c752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:23 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9c696466-4e87-4d3e-a26e-0fb815b0bcd6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created volume successfully. Apr 25 02:18:23 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.494s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:23 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Deleted volume successfully. Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-1218c807-b4bf-430f-b580-4741ee15c371 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-e732dd01-85fa-4c20-b182-5c73697f6f12-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:23 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 1073741824" returned: 0 in 0.630s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:23 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:23 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 Apr 25 02:18:23 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-0def201e-9d97-4def-a4d0-87e00287dc56-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-0def201e-9d97-4def-a4d0-87e00287dc56-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:24 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0" returned: 0 in 0.494s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.936s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-681492781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69433dd0-0395-44e6-9eb1-d05bb9bdec3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:17Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Creating volume 69433dd0-0395-44e6-9eb1-d05bb9bdec3e {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:24 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0683645e-a194-4a84-85f7-c52e0d383cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd54768d-5bae-49c2-b204-8cda0601ffa0', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:24 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e 1073741824 Apr 25 02:18:24 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090a0cef-60fe-4389-9520-f888b741247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-quobyte-0def201e-9d97-4def-a4d0-87e00287dc56" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:24 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Volume volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 (cd54768d-5bae-49c2-b204-8cda0601ffa0): created successfully Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090a0cef-60fe-4389-9520-f888b741247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Flow 'volume_create_manager' (4c87f01d-d652-45a2-a227-e9063c52eeae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:24 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f058f094-fadb-4f26-857d-0e1a0239489b tempest-SnapshotDependencyTests-1303616377 None] Created volume successfully. Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-0def201e-9d97-4def-a4d0-87e00287dc56" acquired by "delete_volume" :: waited 0.053s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4985e615-ac34-440e-817b-ff2d8e13efa6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Flow 'volume_create_manager' (f4ea6185-2d8a-4279-9ab7-0eaffaf2e7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63f7af5-2813-41d0-918b-5dfd34fcdc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63f7af5-2813-41d0-918b-5dfd34fcdc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1034121078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f1d4b5-6efa-4e51-983f-08bdfd38791f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3818c5f85e40431f88a7400783efe122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:25Z,use_quota=True,user_id='bfc1e936317541f6aa9c7845914881ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538a9f9e-8db3-4824-8ae4-8ec493db3b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538a9f9e-8db3-4824-8ae4-8ec493db3b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4777f-1df4-43c3-9021-0084907ee3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b4777f-1df4-43c3-9021-0084907ee3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f1d4b5-6efa-4e51-983f-08bdfd38791f', 'volume_name': 'volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411be369-7db1-40d2-9e91-ad7a81542fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:24 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56 Apr 25 02:18:24 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411be369-7db1-40d2-9e91-ad7a81542fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afcc54b-ca19-40f2-ae73-75d077852c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:24 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Volume 77f1d4b5-6efa-4e51-983f-08bdfd38791f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f', 'volume_size': 1} Apr 25 02:18:24 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:25 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e 1073741824" returned: 0 in 0.620s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:25 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e Apr 25 02:18:25 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:25 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56" returned: 0 in 0.608s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:25 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56 Apr 25 02:18:25 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:25 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e" returned: 0 in 0.470s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1034121078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f1d4b5-6efa-4e51-983f-08bdfd38791f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3818c5f85e40431f88a7400783efe122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:25Z,use_quota=True,user_id='bfc1e936317541f6aa9c7845914881ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Creating volume 77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:25 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:25 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f 1073741824 Apr 25 02:18:25 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312a172b-1cbb-4363-b8df-987a554bf784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16c6b8a-e6ac-4b39-9870-e36d834b65dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:25 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e (69433dd0-0395-44e6-9eb1-d05bb9bdec3e): created successfully Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16c6b8a-e6ac-4b39-9870-e36d834b65dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (581937f0-85eb-450e-bb27-96c4c719bde0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:25 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-ef9f00d0-ee52-4cf9-a337-4e2f51fc887c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created volume successfully. Apr 25 02:18:25 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-0def201e-9d97-4def-a4d0-87e00287dc56" returned: 0 in 0.489s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-0def201e-9d97-4def-a4d0-87e00287dc56" released by "delete_volume" :: held 1.157s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created reservations ['52c4be7a-560c-45cc-bfec-b77ea9647628', '06093d4f-739c-48e5-ba24-3fc5606dbebe', 'fb60db5f-836b-4435-92cb-517eb1b04684', 'b8e1f4df-6f42-4acc-80e2-e608c3aeab8e'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:25 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:25 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:25 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (1db907c5-8b40-4139-916f-5006b7735313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:26 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabf1871-a43d-4d2e-9652-5382a160a72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f 1073741824" returned: 0 in 0.701s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabf1871-a43d-4d2e-9652-5382a160a72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801760635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65625f3e-a94b-4287-8e46-f3b760584392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:26Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4ac359-378f-4726-808e-cbd9fbcfb6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4ac359-378f-4726-808e-cbd9fbcfb6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac2b1fd-9c97-495c-95e5-ac7906b07d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac2b1fd-9c97-495c-95e5-ac7906b07d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65625f3e-a94b-4287-8e46-f3b760584392', 'volume_name': 'volume-65625f3e-a94b-4287-8e46-f3b760584392', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b0b839-6e14-437c-9985-500b38b7b5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b0b839-6e14-437c-9985-500b38b7b5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3377696-ea20-403f-b97e-636d88c389a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume 65625f3e-a94b-4287-8e46-f3b760584392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65625f3e-a94b-4287-8e46-f3b760584392', 'volume_size': 1} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:26 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f Apr 25 02:18:26 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:26 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.583s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:26 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Deleted volume successfully. Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-673c23d8-3955-477b-b1f4-77e366e027d4 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-0def201e-9d97-4def-a4d0-87e00287dc56-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (169ae1fb-3b47-4a65-8bfb-26577e06ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a01c88-eee2-4186-aafd-fe2ae64245c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a01c88-eee2-4186-aafd-fe2ae64245c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2129597305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc45d865-df30-4698-b650-91dff882d912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:26Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a136504b-7174-482f-ac58-0c56b609583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a136504b-7174-482f-ac58-0c56b609583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ba0137-1a3d-4a15-a664-8f2ef66cd50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ba0137-1a3d-4a15-a664-8f2ef66cd50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc45d865-df30-4698-b650-91dff882d912', 'volume_name': 'volume-bc45d865-df30-4698-b650-91dff882d912', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944287f3-7ba1-45e6-b9ed-a2ae227c794c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (944287f3-7ba1-45e6-b9ed-a2ae227c794c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38d554b-81e2-4d60-af02-1efa4f211d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume bc45d865-df30-4698-b650-91dff882d912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc45d865-df30-4698-b650-91dff882d912', 'volume_size': 1} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-7e4b0194-4aa3-443e-a729-c9f60c368abd-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-7e4b0194-4aa3-443e-a729-c9f60c368abd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-quobyte-7e4b0194-4aa3-443e-a729-c9f60c368abd" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-7e4b0194-4aa3-443e-a729-c9f60c368abd" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[111e16eb-4f24-4194-93fc-d9eb60efe773]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (d1fce2ef-4f3e-41aa-85d3-da90071491d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e297bd85-f187-471c-baa6-f48c37bdadae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e297bd85-f187-471c-baa6-f48c37bdadae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712223040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8b6f42-cc9b-4d85-a961-31ba0453b88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:27Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09245714-79cf-43d1-a572-05327c5ac4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd Apr 25 02:18:26 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09245714-79cf-43d1-a572-05327c5ac4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27e241a-294e-46a8-baae-2c8a28ef6796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27e241a-294e-46a8-baae-2c8a28ef6796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8b6f42-cc9b-4d85-a961-31ba0453b88c', 'volume_name': 'volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e22b88-0591-4d6a-bee6-c9b0ad9e7b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e22b88-0591-4d6a-bee6-c9b0ad9e7b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61dc62a-a9fa-426a-b3a2-e9f40630b41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:26 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume fc8b6f42-cc9b-4d85-a961-31ba0453b88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c', 'volume_size': 1} Apr 25 02:18:26 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:27 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f" returned: 0 in 0.630s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.474s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afcc54b-ca19-40f2-ae73-75d077852c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcd5433-d187-4bf1-8554-bae40427c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Creating offline snapshot b8f9afad-04d8-44e2-9925-a0b048dbeb7b of volume cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:18:27 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Volume volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f (77f1d4b5-6efa-4e51-983f-08bdfd38791f): created successfully Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfcd5433-d187-4bf1-8554-bae40427c278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Flow 'volume_create_manager' (f4ea6185-2d8a-4279-9ab7-0eaffaf2e7ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd92e80-3c34-4cd5-86f7-ce1ce7f77501]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:27 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e7427059-bff2-4b02-af08-4bf743cac767 tempest-VolumeDependencyTests-1519311421 None] Created volume successfully. Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (a0a7979e-ee47-423c-bb07-45109f3113d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:27 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 Apr 25 02:18:27 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e811c-f618-496d-a95c-5367216f20d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e811c-f618-496d-a95c-5367216f20d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2049766855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b508f1db-eeec-4783-b813-6a6cec356efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:27Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec25a14-b3cb-4fb1-88dd-2fe0c6eb5f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec25a14-b3cb-4fb1-88dd-2fe0c6eb5f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4587e28e-b495-4889-80fb-27e607221656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4587e28e-b495-4889-80fb-27e607221656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b508f1db-eeec-4783-b813-6a6cec356efa', 'volume_name': 'volume-b508f1db-eeec-4783-b813-6a6cec356efa', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9934864d-78f1-4ce8-bc52-6e99b12703a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9934864d-78f1-4ce8-bc52-6e99b12703a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bca477-31b0-4c67-ae28-4b569a6c0886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume b508f1db-eeec-4783-b813-6a6cec356efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b508f1db-eeec-4783-b813-6a6cec356efa', 'volume_size': 1} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (83fda379-1082-470b-953c-3bac9c4766aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ff5602-3887-4127-ad3a-260c7edf1b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ff5602-3887-4127-ad3a-260c7edf1b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-554740295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d383bc0-3799-4bbb-8740-728200c275bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:27Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d643898d-2e34-4aa3-8303-9f463d260331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d643898d-2e34-4aa3-8303-9f463d260331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a74387-e0fc-4ca4-8db3-288e71c1c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a74387-e0fc-4ca4-8db3-288e71c1c268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d383bc0-3799-4bbb-8740-728200c275bc', 'volume_name': 'volume-1d383bc0-3799-4bbb-8740-728200c275bc', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5616337f-9a20-43f2-89e8-a00c262a7018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5616337f-9a20-43f2-89e8-a00c262a7018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f204a8-4f04-45a0-afe9-5cf46304d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:27 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume 1d383bc0-3799-4bbb-8740-728200c275bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d383bc0-3799-4bbb-8740-728200c275bc', 'volume_size': 1} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:27 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd" returned: 0 in 0.645s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:27 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd Apr 25 02:18:27 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:27 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0" returned: 0 in 0.608s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:27 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b 1G Apr 25 02:18:27 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:27 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7e4b0194-4aa3-443e-a729-c9f60c368abd" returned: 0 in 0.475s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:27 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-7e4b0194-4aa3-443e-a729-c9f60c368abd" released by "delete_volume" :: held 1.167s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Created reservations ['f48708ae-021e-45db-bfe1-0a19480a51df', '5749937b-ac1a-4ff1-afc3-b9aba5ffdbfe', 'c54d220e-3407-4b6d-a2db-a61ea4e07351', 'f25b19a6-d932-48bd-affe-71795404f1a6'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:28 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:28 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Flow 'volume_create_manager' (097735fb-c93a-49e9-bcd2-74e324ec6f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be1f0e8-3983-4aff-b107-9d0eeab14e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be1f0e8-3983-4aff-b107-9d0eeab14e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-960453323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460a10b7-5579-4d39-bb91-4745413da326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3818c5f85e40431f88a7400783efe122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=77f1d4b5-6efa-4e51-983f-08bdfd38791f,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:28Z,use_quota=True,user_id='bfc1e936317541f6aa9c7845914881ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5007604-cd51-42ae-8b8a-a41a8172af17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5007604-cd51-42ae-8b8a-a41a8172af17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6cff73-1a70-4828-bb4c-2f378786b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6cff73-1a70-4828-bb4c-2f378786b951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '460a10b7-5579-4d39-bb91-4745413da326', 'volume_name': 'volume-460a10b7-5579-4d39-bb91-4745413da326', 'volume_size': 1, 'source_volid': '77f1d4b5-6efa-4e51-983f-08bdfd38791f', 'source_volstatus': 'available'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1aada3a-e695-4e31-9b8e-86e5d5409953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1aada3a-e695-4e31-9b8e-86e5d5409953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c2dc7e-7fe4-4421-9c91-70d7e52dc767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:28 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Volume 460a10b7-5579-4d39-bb91-4745413da326: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-460a10b7-5579-4d39-bb91-4745413da326', 'volume_size': 1, 'source_volid': '77f1d4b5-6efa-4e51-983f-08bdfd38791f', 'source_volstatus': 'available'} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:28 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b 1G" returned: 0 in 0.656s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:28 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b Apr 25 02:18:28 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:28 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.481s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:28 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Deleted volume successfully. Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-9d1ef1c1-b230-4f26-ab03-f6947645cc2b tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-7e4b0194-4aa3-443e-a729-c9f60c368abd-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:28 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b" returned: 0 in 0.485s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:28 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b is being set with open permissions: ugo+rw Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:28 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b Apr 25 02:18:28 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-f63a1d77-f281-4224-a5fc-c484a60340e0-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:28 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-f63a1d77-f281-4224-a5fc-c484a60340e0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-quobyte-f63a1d77-f281-4224-a5fc-c484a60340e0" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-f63a1d77-f281-4224-a5fc-c484a60340e0" acquired by "delete_volume" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1720689-89d4-4fbe-bafe-5392334d6403]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:29 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0 Apr 25 02:18:29 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:29 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b" returned: 0 in 0.483s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:29 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.info Apr 25 02:18:29 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:29 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0" returned: 0 in 0.579s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:29 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0 Apr 25 02:18:29 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:29 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.info" returned: 0 in 0.504s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:29 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.info is being set with open permissions: ugo+rw Apr 25 02:18:29 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:29 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.info Apr 25 02:18:29 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:30 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f63a1d77-f281-4224-a5fc-c484a60340e0" returned: 0 in 0.435s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-f63a1d77-f281-4224-a5fc-c484a60340e0" released by "delete_volume" :: held 1.066s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=107,cinder:UPDATE=141,cinder:INSERT=37,cinder:DELETE=16 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=128,cinder:UPDATE=158,cinder:INSERT=31,cinder:DELETE=14 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created reservations ['66862492-e188-4b7f-abd9-1faf18f9d2c9', 'ef73df66-6dc1-4fc3-a6b1-890f86f8b232', '49a1ebf3-cf5e-4a5a-b2dd-9479b90853a4', '06a707c1-46c4-42f9-8ee4-2404bad0b0c6'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:30 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:30 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:30 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.info" returned: 0 in 0.449s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.335s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.998s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801760635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65625f3e-a94b-4287-8e46-f3b760584392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:26Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Creating volume 65625f3e-a94b-4287-8e46-f3b760584392 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:30 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:30 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392 1073741824 Apr 25 02:18:30 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:30 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b45de6ef-8d22-48f9-9c00-73a216519109 tempest-SnapshotDependencyTests-1303616377 None] Create snapshot completed successfully Apr 25 02:18:30 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.443s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:30 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Deleted volume successfully. Apr 25 02:18:30 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-22058e7d-6fee-4530-a34f-1c44378af9c3 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-f63a1d77-f281-4224-a5fc-c484a60340e0-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:31 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392 1073741824" returned: 0 in 0.631s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:31 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392 Apr 25 02:18:31 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-81d64cdf-2162-4f13-9720-9e2df52efb5b-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Flow 'volume_create_manager' (a3fd5f1e-20a7-4e61-a2ee-8bec4269809f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec84a2d-a52b-4303-a4aa-aca1fe648815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-81d64cdf-2162-4f13-9720-9e2df52efb5b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec84a2d-a52b-4303-a4aa-aca1fe648815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f96d3a-9d5c-4544-9488-5ad744d664e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396285c3817a4aa3917355df3cf7e590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8f9afad-04d8-44e2-9925-a0b048dbeb7b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:31Z,use_quota=True,user_id='2adaa3961f3843718f22ad97b5b5dab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841efea5-9ecc-4ebe-ba8c-49e036d1a381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841efea5-9ecc-4ebe-ba8c-49e036d1a381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6600e4bb-9312-435b-834e-00bf419ee6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6600e4bb-9312-435b-834e-00bf419ee6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38f96d3a-9d5c-4544-9488-5ad744d664e8', 'volume_name': 'volume-38f96d3a-9d5c-4544-9488-5ad744d664e8', 'volume_size': 1, 'snapshot_id': 'b8f9afad-04d8-44e2-9925-a0b048dbeb7b'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac43c28e-e723-4ef4-ba85-e313c904faa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac43c28e-e723-4ef4-ba85-e313c904faa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781112c6-09da-495a-8677-4e5fde10852a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:31 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Volume 38f96d3a-9d5c-4544-9488-5ad744d664e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38f96d3a-9d5c-4544-9488-5ad744d664e8', 'volume_size': 1, 'snapshot_id': 'b8f9afad-04d8-44e2-9925-a0b048dbeb7b'} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-quobyte-81d64cdf-2162-4f13-9720-9e2df52efb5b" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-81d64cdf-2162-4f13-9720-9e2df52efb5b" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd2b1ef-20d3-460e-9b60-f06983dd8805]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:31 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b Apr 25 02:18:31 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:31 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392" returned: 0 in 0.530s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.984s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2129597305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc45d865-df30-4698-b650-91dff882d912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:26Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Creating volume bc45d865-df30-4698-b650-91dff882d912 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:31 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3377696-ea20-403f-b97e-636d88c389a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65625f3e-a94b-4287-8e46-f3b760584392', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0690552-1e40-45c5-8fbe-fb42fd60eb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:31 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912 1073741824 Apr 25 02:18:31 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:31 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume volume-65625f3e-a94b-4287-8e46-f3b760584392 (65625f3e-a94b-4287-8e46-f3b760584392): created successfully Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0690552-1e40-45c5-8fbe-fb42fd60eb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (1db907c5-8b40-4139-916f-5006b7735313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:31 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-980d00c9-4466-416a-8bd6-9c7edcc92e6f tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created volume successfully. Apr 25 02:18:31 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b" returned: 0 in 0.550s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:31 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:31 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b Apr 25 02:18:31 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:32 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912 1073741824" returned: 0 in 0.656s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:32 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912 Apr 25 02:18:32 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:32 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-81d64cdf-2162-4f13-9720-9e2df52efb5b" returned: 0 in 0.489s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-81d64cdf-2162-4f13-9720-9e2df52efb5b" released by "delete_volume" :: held 1.075s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created reservations ['7459b2fb-665a-4088-b480-a452bdf84966', '7646ffdf-9f9f-48bb-acc1-8a3b6ef82224', '2d77a265-53e4-47d4-9d78-91bb3dcdd427', '1cdb4165-8c6e-4e91-bb6d-8bcc462513c6'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:32 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:32 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:32 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912" returned: 0 in 0.481s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.811s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712223040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8b6f42-cc9b-4d85-a961-31ba0453b88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:27Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Creating volume fc8b6f42-cc9b-4d85-a961-31ba0453b88c {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:32 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:32 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c 1073741824 Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38d554b-81e2-4d60-af02-1efa4f211d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc45d865-df30-4698-b650-91dff882d912', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:32 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29189f13-28b6-407e-bcb5-37048d75630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:32 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume volume-bc45d865-df30-4698-b650-91dff882d912 (bc45d865-df30-4698-b650-91dff882d912): created successfully Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29189f13-28b6-407e-bcb5-37048d75630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (169ae1fb-3b47-4a65-8bfb-26577e06ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:32 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-65f5fb70-c7da-4142-8a14-63dcd384c1d9 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created volume successfully. Apr 25 02:18:32 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.448s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:32 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:32 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Deleted volume successfully. Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-dc54e2f1-4339-457c-b3a0-982b75cf4d96 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-81d64cdf-2162-4f13-9720-9e2df52efb5b-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:33 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c 1073741824" returned: 0 in 0.613s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-7302f4bc-72f8-4b67-b477-3f0c761d690a-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-7302f4bc-72f8-4b67-b477-3f0c761d690a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:33 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c Apr 25 02:18:33 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-quobyte-7302f4bc-72f8-4b67-b477-3f0c761d690a" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-7302f4bc-72f8-4b67-b477-3f0c761d690a" acquired by "delete_volume" :: waited 0.023s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[41122d02-c15b-4705-965f-26fcfda19e68]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:33 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a Apr 25 02:18:33 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:33 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c" returned: 0 in 0.476s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.644s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2049766855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b508f1db-eeec-4783-b813-6a6cec356efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:27Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Creating volume b508f1db-eeec-4783-b813-6a6cec356efa {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:33 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61dc62a-a9fa-426a-b3a2-e9f40630b41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4db04e-59ed-4242-a2c8-2af1624f0008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:33 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa 1073741824 Apr 25 02:18:33 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:33 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c (fc8b6f42-cc9b-4d85-a961-31ba0453b88c): created successfully Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4db04e-59ed-4242-a2c8-2af1624f0008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:33 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (d1fce2ef-4f3e-41aa-85d3-da90071491d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:33 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-20f6567e-f81f-4032-8e2e-da4b0e996a3c tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created volume successfully. Apr 25 02:18:34 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a" returned: 0 in 0.546s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:34 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a Apr 25 02:18:34 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:34 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa 1073741824" returned: 0 in 0.636s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:34 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-7302f4bc-72f8-4b67-b477-3f0c761d690a" returned: 0 in 0.513s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-7302f4bc-72f8-4b67-b477-3f0c761d690a" released by "delete_volume" :: held 1.099s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:34 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa Apr 25 02:18:34 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created reservations ['d81a0df2-09fe-463a-8390-ae37e10d7bff', '34b388bc-321b-4c3c-84bc-13a70da9250e', 'd0686af0-941b-4584-bd02-2c83b13fcd2a', '6f54993e-90ae-424a-9141-5ca6e19405ac'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:34 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:34 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:34 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:35 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa" returned: 0 in 0.449s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.600s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-554740295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d383bc0-3799-4bbb-8740-728200c275bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f1ce7a35a2f458d92bc172bce12d7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:27Z,use_quota=True,user_id='8c976beb1be940a894dc75e7f72dc203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Creating volume 1d383bc0-3799-4bbb-8740-728200c275bc {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:35 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bca477-31b0-4c67-ae28-4b569a6c0886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b508f1db-eeec-4783-b813-6a6cec356efa', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:35 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc 1073741824 Apr 25 02:18:35 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39d9146-ebdf-45a8-832c-6ab7c3377193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:35 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume volume-b508f1db-eeec-4783-b813-6a6cec356efa (b508f1db-eeec-4783-b813-6a6cec356efa): created successfully Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39d9146-ebdf-45a8-832c-6ab7c3377193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (a0a7979e-ee47-423c-bb07-45109f3113d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:35 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bf2a4423-519b-4fb9-a8ea-d07b67f6a226 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created volume successfully. Apr 25 02:18:35 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.464s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:35 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Deleted volume successfully. Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a1459800-55e5-4c06-af0b-5351212a2966 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-7302f4bc-72f8-4b67-b477-3f0c761d690a-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-3137b1df-b4e2-4611-8240-4040ca4f51fe-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-3137b1df-b4e2-4611-8240-4040ca4f51fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-quobyte-03f47722-ca4a-406f-b359-87b61587c3c9" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-03f47722-ca4a-406f-b359-87b61587c3c9" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-quobyte-3137b1df-b4e2-4611-8240-4040ca4f51fe" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:35 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc 1073741824" returned: 0 in 0.626s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-3137b1df-b4e2-4611-8240-4040ca4f51fe" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Deleting offline snapshot 3137b1df-b4e2-4611-8240-4040ca4f51fe of volume 03f47722-ca4a-406f-b359-87b61587c3c9 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] snapshot_file for this snap is: volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c6376f-d9b4-4edb-9fbb-d1ef063c959b]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:35 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:35 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc Apr 25 02:18:35 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:35 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe Apr 25 02:18:35 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:36 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc" returned: 0 in 0.438s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.927s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:36 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Cloning volume 77f1d4b5-6efa-4e51-983f-08bdfd38791f to volume 460a10b7-5579-4d39-bb91-4745413da326 Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f204a8-4f04-45a0-afe9-5cf46304d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d383bc0-3799-4bbb-8740-728200c275bc', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1870fb92-f0aa-491d-af21-27c894ddf4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:36 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Volume volume-1d383bc0-3799-4bbb-8740-728200c275bc (1d383bc0-3799-4bbb-8740-728200c275bc): created successfully Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1870fb92-f0aa-491d-af21-27c894ddf4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Flow 'volume_create_manager' (83fda379-1082-470b-953c-3bac9c4766aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Creating offline snapshot 05b8123e-094d-48f2-8038-175e755c7e88 of volume 77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:18:36 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-985724ed-6b5a-45be-928c-08f31b9891f5 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created volume successfully. Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[40148401-e64f-454d-8304-0fc5630e3d7e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:36 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe" returned: 0 in 0.559s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03f47722-ca4a-406f-b359-87b61587c3c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[075fcff2-616b-4adf-acb8-cca371f6960f]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:36 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f Apr 25 02:18:36 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:36 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 Apr 25 02:18:36 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:36 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f" returned: 0 in 0.559s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:36 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9" returned: 0 in 0.530s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:36 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:36 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 1G Apr 25 02:18:36 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:36 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe Apr 25 02:18:36 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-1d383bc0-3799-4bbb-8740-728200c275bc-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-1d383bc0-3799-4bbb-8740-728200c275bc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-quobyte-1d383bc0-3799-4bbb-8740-728200c275bc" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-1d383bc0-3799-4bbb-8740-728200c275bc" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ed274-e5b1-4b34-a8b5-e8a045c68568]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:37 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc Apr 25 02:18:37 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:37 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe" returned: 0 in 0.560s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:37 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe Apr 25 02:18:37 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:37 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 1G" returned: 0 in 0.646s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:37 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 Apr 25 02:18:37 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:37 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc" returned: 0 in 0.607s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:37 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc Apr 25 02:18:37 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:37 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9.3137b1df-b4e2-4611-8240-4040ca4f51fe" returned: 0 in 0.437s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-3137b1df-b4e2-4611-8240-4040ca4f51fe" released by "_delete_snapshot" :: held 2.189s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-03f47722-ca4a-406f-b359-87b61587c3c9" released by "delete_snapshot" :: held 2.225s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:37 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Created reservations ['ca160f94-da56-4706-abb8-80961d65706e', 'f3ba321d-c1ea-4186-945b-800956c163f8', 'e9f1b57b-2a13-47b6-8f00-535e64dcdb47', '2108ffc1-1e8b-4b80-b798-25c59801470e'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:38 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88" returned: 0 in 0.520s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:38 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 is being set with open permissions: ugo+rw Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:38 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Delete snapshot completed successfully. Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-b272dbac-92c7-44a5-bd0c-5f7779caaa0e tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-3137b1df-b4e2-4611-8240-4040ca4f51fe-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:38 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 Apr 25 02:18:38 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:38 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-1d383bc0-3799-4bbb-8740-728200c275bc" returned: 0 in 0.450s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-1d383bc0-3799-4bbb-8740-728200c275bc" released by "delete_volume" :: held 1.100s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created reservations ['4e89db4a-59e2-4eae-8a24-23c66b222b4c', 'd0416ba7-0109-4fce-b876-4b3587058d02', '57b22848-4af7-44af-bb05-2ef6ff9bae4e', '85524215-4255-4d16-806d-64cf819a0fb9'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:38 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:38 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:38 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88" returned: 0 in 0.451s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:38 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.info Apr 25 02:18:38 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-03f47722-ca4a-406f-b359-87b61587c3c9-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-03f47722-ca4a-406f-b359-87b61587c3c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:38 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "cinder-quobyte-03f47722-ca4a-406f-b359-87b61587c3c9" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.506s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:38 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Deleted volume successfully. Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-03f47722-ca4a-406f-b359-87b61587c3c9" acquired by "delete_volume" :: waited 0.034s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-80065323-e713-4153-8a4d-b83c90d76b10 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-1d383bc0-3799-4bbb-8740-728200c275bc-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d83657-7d6d-4908-9eef-6db19e64f9e8]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:38 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:39 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.info" returned: 0 in 0.513s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:39 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.info is being set with open permissions: ugo+rw Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:39 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.info Apr 25 02:18:39 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:39 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 Apr 25 02:18:39 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-b508f1db-eeec-4783-b813-6a6cec356efa-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-b508f1db-eeec-4783-b813-6a6cec356efa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-quobyte-b508f1db-eeec-4783-b813-6a6cec356efa" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-b508f1db-eeec-4783-b813-6a6cec356efa" acquired by "delete_volume" :: waited 0.030s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[167ce226-90c4-4b83-aeed-0e038301ad81]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:39 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.info" returned: 0 in 0.477s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-460a10b7-5579-4d39-bb91-4745413da326" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:39 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9" returned: 0 in 0.548s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-460a10b7-5579-4d39-bb91-4745413da326" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] snapshot: 05b8123e-094d-48f2-8038-175e755c7e88, volume: 460a10b7-5579-4d39-bb91-4745413da326, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:18:39 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9 Apr 25 02:18:39 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:39 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa Apr 25 02:18:39 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb152a-bec2-467b-8d4e-ad60a68ace15]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:39 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 Apr 25 02:18:39 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:39 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:39 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-03f47722-ca4a-406f-b359-87b61587c3c9" returned: 0 in 0.454s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-quobyte-03f47722-ca4a-406f-b359-87b61587c3c9" released by "delete_volume" :: held 1.058s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:40 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Created reservations ['c2f31cac-82e2-42bb-8a3b-9c3cd4deef7b', '097a7cbb-e643-4266-97a0-2a676ae9e18d', '5d8667b7-9309-4601-bc52-8d0540c6668b', '1987fd90-0410-4b1a-8c2f-0ab8876f5bd4'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa" returned: 0 in 0.572s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:40 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa Apr 25 02:18:40 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:40 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:40 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:40 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88" returned: 0 in 0.577s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f883665b-894f-43aa-9f21-662db15c6847]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:40 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f Apr 25 02:18:40 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:40 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-b508f1db-eeec-4783-b813-6a6cec356efa" returned: 0 in 0.472s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-b508f1db-eeec-4783-b813-6a6cec356efa" released by "delete_volume" :: held 1.082s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created reservations ['83b0def3-a945-4873-9158-3d7f4c7ed7d2', '77814f90-868c-40c0-a6ee-928b71882c96', '4c71cf0c-3c5d-439d-900f-3937294d2dbd', 'e0fd8884-40b5-43ff-a9b6-6756409615bb'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:40 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.481s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:40 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Deleted volume successfully. Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-645bd2d4-0dca-4ef8-a309-c92b015a13e6 tempest-CreateVolumesFromSnapshotTest-337969400 None] Lock "cinder-03f47722-ca4a-406f-b359-87b61587c3c9-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:40 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:40 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:40 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f" returned: 0 in 0.582s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:18:40 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:40 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 Apr 25 02:18:40 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:41 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.451s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:41 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:41 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Deleted volume successfully. Apr 25 02:18:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0aec6f81-b452-4a50-97a7-022a29bc6c03 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-b508f1db-eeec-4783-b813-6a6cec356efa-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-fc8b6f42-cc9b-4d85-a961-31ba0453b88c-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-fc8b6f42-cc9b-4d85-a961-31ba0453b88c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-quobyte-fc8b6f42-cc9b-4d85-a961-31ba0453b88c" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:41 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-fc8b6f42-cc9b-4d85-a961-31ba0453b88c" acquired by "delete_volume" :: waited 0.048s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:41 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b55f7c3-be73-43fc-b1f6-e10da526a41d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:41 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:42 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c Apr 25 02:18:42 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:43 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c" returned: 0 in 1.129s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:43 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:43 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c Apr 25 02:18:43 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:44 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-fc8b6f42-cc9b-4d85-a961-31ba0453b88c" returned: 0 in 1.148s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:44 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-fc8b6f42-cc9b-4d85-a961-31ba0453b88c" released by "delete_volume" :: held 2.432s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:44 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created reservations ['b5b320dc-cf68-4dbd-88f1-f0a7b093b65f', '0ca81dad-6cff-44a5-92ed-11982a63e0fc', 'c7ad2756-243a-41d6-9147-129e0f16c9ce', '52ef1a43-4e1c-4010-aca2-5626ce904e52'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:44 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:44 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:44 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:44 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-bc45d865-df30-4698-b650-91dff882d912-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-bc45d865-df30-4698-b650-91dff882d912-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-quobyte-bc45d865-df30-4698-b650-91dff882d912" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-bc45d865-df30-4698-b650-91dff882d912" acquired by "delete_volume" :: waited 0.038s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:45 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea0c9fa-6ce9-4725-8e5d-369e95f59dd6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:45 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:45 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.239s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:45 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:45 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Deleted volume successfully. Apr 25 02:18:45 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c3be8256-bca9-4111-a339-5b4d4c690264 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-fc8b6f42-cc9b-4d85-a961-31ba0453b88c-delete_volume" released by "delete_volume" :: held 4.115s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:45 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912 Apr 25 02:18:45 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:46 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326" returned: 0 in 5.620s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:46 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[447dbe52-fa5f-4dd5-bfb4-ee7a7a17c20c]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:46 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f Apr 25 02:18:46 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:46 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912" returned: 0 in 0.809s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:46 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912 Apr 25 02:18:46 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:46 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:46 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-bc45d865-df30-4698-b650-91dff882d912" returned: 0 in 0.447s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:46 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-bc45d865-df30-4698-b650-91dff882d912" released by "delete_volume" :: held 1.328s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created reservations ['e85a2bac-a4a6-42c0-800a-fc9b3ca11fca', 'ac5abe3b-23bf-4266-a0a6-3ed03584a37b', '7cfbe79a-24f5-48c7-9f60-a2e4b92d8015', '912cc8cd-855a-48aa-b690-e28c8ed29829'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:47 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f" returned: 0 in 0.705s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:18:47 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Converted 1024.00 MB image at 182.17 MB/s Apr 25 02:18:47 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 is being set with open permissions: ugo+rw Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:47 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:47 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:47 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 Apr 25 02:18:47 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:47 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326" returned: 0 in 0.432s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-460a10b7-5579-4d39-bb91-4745413da326" released by "_copy_volume_from_snapshot" :: held 8.004s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-05b8123e-094d-48f2-8038-175e755c7e88" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-05b8123e-094d-48f2-8038-175e755c7e88" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:47 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Deleting offline snapshot 05b8123e-094d-48f2-8038-175e755c7e88 of volume 77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] snapshot_file for this snap is: volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.500s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:47 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Deleted volume successfully. Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feae30d-b4e3-4f8a-a631-bf651f8eec34]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-839b0137-b977-4a40-9145-c01722b72e73 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-bc45d865-df30-4698-b650-91dff882d912-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:47 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 Apr 25 02:18:47 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-65625f3e-a94b-4287-8e46-f3b760584392-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-65625f3e-a94b-4287-8e46-f3b760584392-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-quobyte-65625f3e-a94b-4287-8e46-f3b760584392" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-65625f3e-a94b-4287-8e46-f3b760584392" acquired by "delete_volume" :: waited 0.019s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[0315db36-5e3a-4204-a7c9-1e6c5bd31ef5]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:47 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:47 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392 Apr 25 02:18:47 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:48 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88" returned: 0 in 0.554s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98646a1-0f3f-46d8-aaab-8dcec836de88]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:48 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f Apr 25 02:18:48 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:48 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392" returned: 0 in 0.526s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:48 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392 Apr 25 02:18:48 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:48 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f" returned: 0 in 0.560s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:48 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 Apr 25 02:18:48 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:48 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-65625f3e-a94b-4287-8e46-f3b760584392" returned: 0 in 0.461s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-65625f3e-a94b-4287-8e46-f3b760584392" released by "delete_volume" :: held 1.035s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created reservations ['b77f99a2-5eb5-41f4-aa7b-96515a2918af', 'eb2dc77b-2e85-46b6-82b4-0a9626c9d650', 'a59665c0-6a5d-422f-a82b-cce65bb5886f', 'e4df351f-94a8-417a-9335-8b88940ee2c8'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:48 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:48 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:48 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:49 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88" returned: 0 in 0.572s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:49 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88 Apr 25 02:18:49 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:49 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.475s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:49 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Deleted volume successfully. Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-bc5155fa-b9cf-4063-baf4-d7d68192670b tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-65625f3e-a94b-4287-8e46-f3b760584392-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:49 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f.05b8123e-094d-48f2-8038-175e755c7e88" returned: 0 in 0.469s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-05b8123e-094d-48f2-8038-175e755c7e88" released by "_delete_snapshot" :: held 2.238s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.628s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 18.538s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "cinder-quobyte-b8f9afad-04d8-44e2-9925-a0b048dbeb7b-38f96d3a-9d5c-4544-9488-5ad744d664e8" by "_create_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c2dc7e-7fe4-4421-9c91-70d7e52dc767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-460a10b7-5579-4d39-bb91-4745413da326', 'volume_size': 1, 'source_volid': '77f1d4b5-6efa-4e51-983f-08bdfd38791f', 'source_volstatus': 'available'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf69e071-9e6d-42a7-b15c-49a27eb68723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-b8f9afad-04d8-44e2-9925-a0b048dbeb7b-38f96d3a-9d5c-4544-9488-5ad744d664e8" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Creating volume 38f96d3a-9d5c-4544-9488-5ad744d664e8 from snapshot b8f9afad-04d8-44e2-9925-a0b048dbeb7b {{(pid=81927) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "cinder-quobyte-38f96d3a-9d5c-4544-9488-5ad744d664e8" by "_copy_volume_from_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:49 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Volume volume-460a10b7-5579-4d39-bb91-4745413da326 (460a10b7-5579-4d39-bb91-4745413da326): created successfully Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf69e071-9e6d-42a7-b15c-49a27eb68723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Flow 'volume_create_manager' (097735fb-c93a-49e9-bcd2-74e324ec6f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-38f96d3a-9d5c-4544-9488-5ad744d664e8" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] snapshot: b8f9afad-04d8-44e2-9925-a0b048dbeb7b, volume: 38f96d3a-9d5c-4544-9488-5ad744d664e8, {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:49 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-69433dd0-0395-44e6-9eb1-d05bb9bdec3e-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:50 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-43e7c231-1c77-4521-90e0-13da33b05f29 tempest-VolumeDependencyTests-1519311421 None] Created volume successfully. Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[a524da1e-a281-48bb-8175-7386f432d417]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-69433dd0-0395-44e6-9eb1-d05bb9bdec3e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "cinder-quobyte-69433dd0-0395-44e6-9eb1-d05bb9bdec3e" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-69433dd0-0395-44e6-9eb1-d05bb9bdec3e" acquired by "delete_volume" :: waited 0.013s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5faa973-4fc6-465f-9a95-18b18d210ebc]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:50 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b Apr 25 02:18:50 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:50 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e Apr 25 02:18:50 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:50 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b" returned: 0 in 0.553s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd54768d-5bae-49c2-b204-8cda0601ffa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Creating direct copy from snapshot {{(pid=81927) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[e452ca57-0cbd-452b-8d79-c6efa7d3234e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:50 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e" returned: 0 in 0.537s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:50 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 Apr 25 02:18:50 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:50 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e Apr 25 02:18:50 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-77f1d4b5-6efa-4e51-983f-08bdfd38791f-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-77f1d4b5-6efa-4e51-983f-08bdfd38791f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-77f1d4b5-6efa-4e51-983f-08bdfd38791f" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-77f1d4b5-6efa-4e51-983f-08bdfd38791f" acquired by "delete_volume" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2303a9-8926-42dc-9b60-358cde4bb4b6]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:50 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:50 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f Apr 25 02:18:50 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:51 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0" returned: 0 in 0.574s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG cinder.utils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Path /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 not found in is_blk_device check {{(pid=81927) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:51 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 Apr 25 02:18:51 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:51 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-69433dd0-0395-44e6-9eb1-d05bb9bdec3e" returned: 0 in 0.553s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-quobyte-69433dd0-0395-44e6-9eb1-d05bb9bdec3e" released by "delete_volume" :: held 1.128s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Created reservations ['bd06b391-6870-4c6e-a355-382cca2054a5', '08728450-6adf-4772-a2ac-53d1c8085be7', '033de464-8577-40e4-ba52-8f96fab88acc', '25bd8d1c-4d54-414d-9450-31110157600d'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:51 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:51 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:51 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f" returned: 0 in 0.564s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:51 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:51 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f Apr 25 02:18:51 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:52 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.679s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:52 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Deleted volume successfully. Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-15e501ec-a235-4db1-a31d-5eefe336db27 tempest-CreateVolumesFromSourceVolumeTest-1321151004 None] Lock "cinder-69433dd0-0395-44e6-9eb1-d05bb9bdec3e-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:52 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-77f1d4b5-6efa-4e51-983f-08bdfd38791f" returned: 0 in 0.698s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-77f1d4b5-6efa-4e51-983f-08bdfd38791f" released by "delete_volume" :: held 1.349s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Created reservations ['f0bc32c6-5036-4ba8-98a8-07fe54c741d4', 'ebccc330-0adf-4421-a712-5c72b9edc747', '1f8b2096-3bbc-499b-a92c-f518ef017914', '4c128075-96d0-4b97-b5c9-69bdef1cab1c'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:52 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:52 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:52 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-460a10b7-5579-4d39-bb91-4745413da326-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-460a10b7-5579-4d39-bb91-4745413da326-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-460a10b7-5579-4d39-bb91-4745413da326" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-460a10b7-5579-4d39-bb91-4745413da326" acquired by "delete_volume" :: waited 0.066s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:53 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[c223fe4f-100a-4e0e-b31b-dcd7aa14be50]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:53 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 Apr 25 02:18:53 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:53 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:53 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.415s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:53 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:53 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Deleted volume successfully. Apr 25 02:18:53 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-c64c7b8c-316b-4d87-8ec8-71cf2884b9e7 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-77f1d4b5-6efa-4e51-983f-08bdfd38791f-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:54 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326" returned: 0 in 0.964s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:54 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:54 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326 Apr 25 02:18:54 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:55 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-460a10b7-5579-4d39-bb91-4745413da326" returned: 0 in 1.042s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:55 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-460a10b7-5579-4d39-bb91-4745413da326" released by "delete_volume" :: held 2.110s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:55 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Created reservations ['d2922c13-e1b0-4fbb-b4b2-4b2fb945cb30', '91fb5720-28e9-44e1-9e35-984bebf1d095', '6390dc0f-51ca-4c0a-8766-ee24287709dc', '59386fa2-3f13-431c-a77d-4708428b89bd'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:55 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:55 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:55 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:55 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:56 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:56 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 1.088s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:56 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:56 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Deleted volume successfully. Apr 25 02:18:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-3e672664-b602-4b75-ab33-16abcb37e219 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-460a10b7-5579-4d39-bb91-4745413da326-delete_volume" released by "delete_volume" :: held 3.686s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-38d41658-149c-4329-bbd0-daa84c5b02cf-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-38d41658-149c-4329-bbd0-daa84c5b02cf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "cinder-quobyte-38d41658-149c-4329-bbd0-daa84c5b02cf" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:56 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-38d41658-149c-4329-bbd0-daa84c5b02cf" acquired by "delete_volume" :: waited 0.020s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[06655f59-5c9f-4a13-afeb-2ef727b277f2]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:57 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf Apr 25 02:18:57 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:57 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8" returned: 0 in 6.055s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc33a645-4ecf-4b97-a5f1-ad4468a5cf4e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:57 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 Apr 25 02:18:57 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Flow 'volume_create_manager' (444fd952-a429-4998-91a9-ff4ea655aaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db81e35-4ae2-485d-a7e4-63ad253612d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db81e35-4ae2-485d-a7e4-63ad253612d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9762066a-04ab-41e4-a241-3afb5fe5f2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9379d4e43c4ab59b5c9cdca5cfadfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:57Z,use_quota=True,user_id='89b25b60605a46779ca759a0c3a77587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd03539-cb40-43db-a692-95ce52e027c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd03539-cb40-43db-a692-95ce52e027c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec0047e-dd69-40f0-9375-39cb19050929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec0047e-dd69-40f0-9375-39cb19050929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9762066a-04ab-41e4-a241-3afb5fe5f2f9', 'volume_name': 'volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067feb04-c0bb-4a0f-b7df-0087babae435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067feb04-c0bb-4a0f-b7df-0087babae435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0837013-a99d-48db-97f0-1e00c594da13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:57 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Volume 9762066a-04ab-41e4-a241-3afb5fe5f2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9', 'volume_size': 1} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:57 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf" returned: 0 in 0.636s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:57 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf Apr 25 02:18:57 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:57 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0" returned: 0 in 0.712s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG cinder.image.image_utils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Image conversion details: src /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 {{(pid=81927) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 02:18:57 devstack cinder-volume[81927]: INFO cinder.image.image_utils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Converted 1024.00 MB image at 169.03 MB/s Apr 25 02:18:57 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 is being set with open permissions: ugo+rw Apr 25 02:18:57 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:57 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 Apr 25 02:18:57 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:58 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38d41658-149c-4329-bbd0-daa84c5b02cf" returned: 0 in 0.449s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-quobyte-38d41658-149c-4329-bbd0-daa84c5b02cf" released by "delete_volume" :: held 1.159s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Created reservations ['ea91f593-ef70-483c-9ee9-f51b321f5c3a', '5eeb7f51-dd69-4eca-abd5-1fb282cd4696', 'd8043181-9bfe-4043-a0cf-0a4685875148', '512ddf9e-766b-4afe-8aea-b05ec4ba5b3a'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:58 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:18:58 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:58 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8" returned: 0 in 0.444s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-38f96d3a-9d5c-4544-9488-5ad744d664e8" released by "_copy_volume_from_snapshot" :: held 8.468s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-b8f9afad-04d8-44e2-9925-a0b048dbeb7b-38f96d3a-9d5c-4544-9488-5ad744d664e8" released by "_create_volume_from_snapshot" :: held 8.520s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.555s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.971s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9762066a-04ab-41e4-a241-3afb5fe5f2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9379d4e43c4ab59b5c9cdca5cfadfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:18:57Z,use_quota=True,user_id='89b25b60605a46779ca759a0c3a77587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Creating volume 9762066a-04ab-41e4-a241-3afb5fe5f2f9 {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:18:58 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:58 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 1073741824 Apr 25 02:18:58 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781112c6-09da-495a-8677-4e5fde10852a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f96d3a-9d5c-4544-9488-5ad744d664e8', 'volume_size': 1, 'snapshot_id': 'b8f9afad-04d8-44e2-9925-a0b048dbeb7b'}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5889b57-54ea-401f-a67f-cd5b4de40200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:58 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Volume volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 (38f96d3a-9d5c-4544-9488-5ad744d664e8): created successfully Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5889b57-54ea-401f-a67f-cd5b4de40200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Flow 'volume_create_manager' (a3fd5f1e-20a7-4e61-a2ee-8bec4269809f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:58 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-0a99510c-47f6-4c7c-9a2c-d7bb17ca900a tempest-SnapshotDependencyTests-1303616377 None] Created volume successfully. Apr 25 02:18:58 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.449s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:18:58 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Deleted volume successfully. Apr 25 02:18:58 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e0e23b8b-a29b-4831-a419-3b6ee4c166a8 tempest-VolumeDependencyTests-1519311421 None] Lock "cinder-38d41658-149c-4329-bbd0-daa84c5b02cf-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:18:59 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 1073741824" returned: 0 in 0.616s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:59 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 Apr 25 02:18:59 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "cinder-b8f9afad-04d8-44e2-9925-a0b048dbeb7b-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-b8f9afad-04d8-44e2-9925-a0b048dbeb7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "cinder-quobyte-cd54768d-5bae-49c2-b204-8cda0601ffa0" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-cd54768d-5bae-49c2-b204-8cda0601ffa0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "cinder-quobyte-b8f9afad-04d8-44e2-9925-a0b048dbeb7b" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-b8f9afad-04d8-44e2-9925-a0b048dbeb7b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Deleting offline snapshot b8f9afad-04d8-44e2-9925-a0b048dbeb7b of volume cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] snapshot_file for this snap is: volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[5772502a-5651-4373-9dc7-9cdcb98e7590]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:18:59 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b Apr 25 02:18:59 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:18:59 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9" returned: 0 in 0.521s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0837013-a99d-48db-97f0-1e00c594da13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d171af45-b2b8-4f1f-913b-57fe8c1334ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:18:59 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Volume volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 (9762066a-04ab-41e4-a241-3afb5fe5f2f9): created successfully Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d171af45-b2b8-4f1f-913b-57fe8c1334ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:18:59 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Flow 'volume_create_manager' (444fd952-a429-4998-91a9-ff4ea655aaaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:18:59 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-f3b5c290-0207-4907-a839-1f3354712b3c tempest-CinderUnicodeTest-1860916158 None] Created volume successfully. Apr 25 02:19:00 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b" returned: 0 in 0.624s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:00 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd54768d-5bae-49c2-b204-8cda0601ffa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:19:00 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e50662-6561-448b-97ac-20641fd6e263]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:19:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:00 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 Apr 25 02:19:00 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:00 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0" returned: 0 in 0.631s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:00 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:00 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b Apr 25 02:19:00 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81927) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Flow 'volume_create_manager' (bd008526-70c9-4f4e-ae28-95ddcba9d21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f67a541-780d-4919-9bbe-96bc70630d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f67a541-780d-4919-9bbe-96bc70630d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:19:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-383036740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ac047f-0224-4f50-83e2-90380b67798f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9379d4e43c4ab59b5c9cdca5cfadfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:19:01Z,use_quota=True,user_id='89b25b60605a46779ca759a0c3a77587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11a5dae-0d01-4d1f-ac38-50347d9856b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11a5dae-0d01-4d1f-ac38-50347d9856b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500f728a-cf77-45da-9b9c-eabc5888fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500f728a-cf77-45da-9b9c-eabc5888fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ac047f-0224-4f50-83e2-90380b67798f', 'volume_name': 'volume-f0ac047f-0224-4f50-83e2-90380b67798f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa44007f-be7b-4594-aaf7-952772c3b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa44007f-be7b-4594-aaf7-952772c3b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ec1192-3bc0-4c64-a894-8173f5a5a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:19:01 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Volume f0ac047f-0224-4f50-83e2-90380b67798f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ac047f-0224-4f50-83e2-90380b67798f', 'volume_size': 1} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T00:19:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-383036740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ac047f-0224-4f50-83e2-90380b67798f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e9379d4e43c4ab59b5c9cdca5cfadfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T00:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T00:19:01Z,use_quota=True,user_id='89b25b60605a46779ca759a0c3a77587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa832417-20fb-48f3-ab94-82eba1ae160a),volume_type_id=fa832417-20fb-48f3-ab94-82eba1ae160a)}" {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Creating volume f0ac047f-0224-4f50-83e2-90380b67798f {{(pid=81927) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Selected osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 as target Quobyte volume. {{(pid=81927) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 02:19:01 devstack cinder-volume[81927]: INFO cinder.volume.drivers.remotefs [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] casted to osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9 Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f 1073741824 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:01 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f 1073741824 Apr 25 02:19:01 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:01 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b" returned: 0 in 0.579s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:01 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b Apr 25 02:19:01 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:01 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f 1073741824" returned: 0 in 0.666s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:01 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f Apr 25 02:19:01 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:01 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0.b8f9afad-04d8-44e2-9925-a0b048dbeb7b" returned: 0 in 0.508s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-b8f9afad-04d8-44e2-9925-a0b048dbeb7b" released by "_delete_snapshot" :: held 2.449s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-cd54768d-5bae-49c2-b204-8cda0601ffa0" released by "delete_snapshot" :: held 2.474s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:01 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Created reservations ['19c1c05c-0d02-47b4-8063-a8ee82f7ecf9', 'bc118ce9-e528-4e22-8b6e-ea77b4b14898', '55afb7ba-c76a-4623-9c1e-5a9bd0c263b2', '7f6ec0ef-87df-44d3-bce2-643bc25c174b'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:19:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Delete snapshot completed successfully. Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf4af84d-0e10-4d22-8ccc-4d20e2c4afc3 tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-b8f9afad-04d8-44e2-9925-a0b048dbeb7b-delete_snapshot" released by "delete_snapshot" :: held 2.601s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:02 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f" returned: 0 in 0.478s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'} {{(pid=81927) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ec1192-3bc0-4c64-a894-8173f5a5a28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ac047f-0224-4f50-83e2-90380b67798f', 'volume_size': 1}' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79812849-7bf5-4b09-b875-759f3bd8fd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 02:19:02 devstack cinder-volume[81927]: INFO cinder.volume.flows.manager.create_volume [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Volume volume-f0ac047f-0224-4f50-83e2-90380b67798f (f0ac047f-0224-4f50-83e2-90380b67798f): created successfully Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79812849-7bf5-4b09-b875-759f3bd8fd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81927) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Flow 'volume_create_manager' (bd008526-70c9-4f4e-ae28-95ddcba9d21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81927) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 02:19:02 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e08de59f-cded-4439-81ca-0045e13479da tempest-CinderUnicodeTest-1860916158 None] Created volume successfully. Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "cinder-cd54768d-5bae-49c2-b204-8cda0601ffa0-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-cd54768d-5bae-49c2-b204-8cda0601ffa0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "cinder-quobyte-cd54768d-5bae-49c2-b204-8cda0601ffa0" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-cd54768d-5bae-49c2-b204-8cda0601ffa0" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[b954d234-d06f-43e1-b1cd-fc089028088d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:19:02 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:02 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 Apr 25 02:19:02 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:03 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0" returned: 0 in 0.566s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:03 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0 Apr 25 02:19:03 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Creating offline snapshot 0a05e321-af1a-40c6-9399-3a88fc746200 of volume f0ac047f-0224-4f50-83e2-90380b67798f {{(pid=81927) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[501caec8-849c-49aa-bb8c-790c0958a76e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:03 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f Apr 25 02:19:03 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:03 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-cd54768d-5bae-49c2-b204-8cda0601ffa0" returned: 0 in 0.478s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-cd54768d-5bae-49c2-b204-8cda0601ffa0" released by "delete_volume" :: held 1.104s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Created reservations ['4d26f710-aea4-4dbb-bf89-4f23df0f3e5c', '13241532-896e-4d8a-bade-652b6555e428', '78f6941f-1005-4b0a-980a-0a2e84932bf9', '3361b486-6c01-414e-8207-c0c8f49343e7'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:03 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:19:03 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:03 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f" returned: 0 in 0.562s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:03 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 1G {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:03 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 1G Apr 25 02:19:03 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:04 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.443s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:19:04 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Deleted volume successfully. Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-e5ebd4b0-4171-4f05-aa87-e01668a0e2ce tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-cd54768d-5bae-49c2-b204-8cda0601ffa0-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:04 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 1G" returned: 0 in 0.609s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ac047f-0224-4f50-83e2-90380b67798f -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:04 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ac047f-0224-4f50-83e2-90380b67798f -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 Apr 25 02:19:04 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "cinder-38f96d3a-9d5c-4544-9488-5ad744d664e8-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-38f96d3a-9d5c-4544-9488-5ad744d664e8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "cinder-quobyte-38f96d3a-9d5c-4544-9488-5ad744d664e8" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-38f96d3a-9d5c-4544-9488-5ad744d664e8" acquired by "delete_volume" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2327f9-7879-4b1b-9146-8a4dd2831b8e]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:19:04 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:04 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 Apr 25 02:19:04 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:05 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0ac047f-0224-4f50-83e2-90380b67798f -F qcow2 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200" returned: 0 in 0.514s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:05 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 is being set with open permissions: ugo+rw Apr 25 02:19:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:05 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 Apr 25 02:19:05 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:05 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8" returned: 0 in 0.545s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:05 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8 Apr 25 02:19:05 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:05 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200" returned: 0 in 0.437s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:05 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.info Apr 25 02:19:05 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:05 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:05 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-38f96d3a-9d5c-4544-9488-5ad744d664e8" returned: 0 in 0.447s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:05 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-quobyte-38f96d3a-9d5c-4544-9488-5ad744d664e8" released by "delete_volume" :: held 1.030s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:05 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Created reservations ['1d0b83ea-f250-40d4-ac25-1d3ccb6c81d7', '6f053d21-7b28-43eb-9125-f68907c3b2d0', '5a4e7429-e552-48f2-9f0d-7817d88bfc72', '949c2296-30f0-43cf-8694-3f793c043833'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:06 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:19:06 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:06 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.info" returned: 0 in 0.503s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:06 devstack cinder-volume[81927]: WARNING cinder.volume.drivers.remotefs [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.info is being set with open permissions: ugo+rw Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.info {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:06 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.info Apr 25 02:19:06 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:06 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.459s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:19:06 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Deleted volume successfully. Apr 25 02:19:06 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.info" returned: 0 in 0.441s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.147s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:19:06 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-37564a0c-f203-4939-baec-5516d2589eae tempest-SnapshotDependencyTests-1303616377 None] Lock "cinder-38f96d3a-9d5c-4544-9488-5ad744d664e8-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:06 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-39668a5c-a088-4f4b-8d62-669e49b60055 tempest-CinderUnicodeTest-1860916158 None] Create snapshot completed successfully Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "cinder-0a05e321-af1a-40c6-9399-3a88fc746200-delete_snapshot" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-0a05e321-af1a-40c6-9399-3a88fc746200-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "cinder-quobyte-f0ac047f-0224-4f50-83e2-90380b67798f" by "delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-quobyte-f0ac047f-0224-4f50-83e2-90380b67798f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "cinder-quobyte-0a05e321-af1a-40c6-9399-3a88fc746200" by "_delete_snapshot" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-quobyte-0a05e321-af1a-40c6-9399-3a88fc746200" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Deleting offline snapshot 0a05e321-af1a-40c6-9399-3a88fc746200 of volume f0ac047f-0224-4f50-83e2-90380b67798f {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] snapshot_file for this snap is: volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 {{(pid=81927) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[89850d15-00b4-41ed-81db-0ee523e1c9f5]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:19:07 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:07 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 Apr 25 02:19:07 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:08 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200" returned: 0 in 0.542s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:08 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.remotefs [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0ac047f-0224-4f50-83e2-90380b67798f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81927) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 02:19:08 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1135b7-daa7-4f21-8121-cf395839c8d4]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:19:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:08 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f Apr 25 02:19:08 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:08 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f" returned: 0 in 0.626s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:08 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:08 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 Apr 25 02:19:08 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:09 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200" returned: 0 in 0.561s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:09 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200 Apr 25 02:19:09 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:09 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:09 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f.0a05e321-af1a-40c6-9399-3a88fc746200" returned: 0 in 0.519s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-quobyte-0a05e321-af1a-40c6-9399-3a88fc746200" released by "_delete_snapshot" :: held 2.372s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-quobyte-f0ac047f-0224-4f50-83e2-90380b67798f" released by "delete_snapshot" :: held 2.397s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Created reservations ['1668fd96-5d76-4aa0-bbf5-57bd9d6229cd', '16361707-e0d8-4407-adfe-80c021102807', '6d16eae4-f9f4-41b1-aba2-9e5908dd1a4d', '94a0c9e1-c2de-433a-8cbd-b709b5d371f0'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:19:10 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Delete snapshot completed successfully. Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-88cc834e-6b98-48dd-b99b-8a067a67c263 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-0a05e321-af1a-40c6-9399-3a88fc746200-delete_snapshot" released by "delete_snapshot" :: held 2.550s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "cinder-f0ac047f-0224-4f50-83e2-90380b67798f-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-f0ac047f-0224-4f50-83e2-90380b67798f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "cinder-quobyte-f0ac047f-0224-4f50-83e2-90380b67798f" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-quobyte-f0ac047f-0224-4f50-83e2-90380b67798f" acquired by "delete_volume" :: waited 0.014s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3d6174-158e-43eb-a5b0-b9d6f7933297]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:19:10 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:10 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f Apr 25 02:19:10 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG oslo_service.periodic_task [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81927) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:11 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:19:11 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:11 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f" returned: 0 in 0.559s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:11 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f Apr 25 02:19:11 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:11 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.615s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:11 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-3a0ec7cb-ad4c-408f-8e7b-ab6379578aef None None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:19:12 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-f0ac047f-0224-4f50-83e2-90380b67798f" returned: 0 in 0.618s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-quobyte-f0ac047f-0224-4f50-83e2-90380b67798f" released by "delete_volume" :: held 1.243s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Created reservations ['06f5126f-37d2-436d-9a9f-3a284cad2712', '307e3773-6ce9-4b47-9739-227db2851fca', 'a4ddead5-6958-493b-a4cf-1ad884186945', '03881898-6bb3-45e7-a1fa-b502a074b1a1'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:12 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:19:12 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:12 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.485s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:19:12 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Deleted volume successfully. Apr 25 02:19:12 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-cf2cc57a-933b-4ed5-bc66-ea9c93d4a5f3 tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-f0ac047f-0224-4f50-83e2-90380b67798f-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "cinder-9762066a-04ab-41e4-a241-3afb5fe5f2f9-delete_volume" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-9762066a-04ab-41e4-a241-3afb5fe5f2f9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "cinder-quobyte-9762066a-04ab-41e4-a241-3afb5fe5f2f9" by "delete_volume" {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 02:19:13 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-quobyte-9762066a-04ab-41e4-a241-3afb5fe5f2f9" acquired by "delete_volume" :: waited 0.015s {{(pid=81927) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 02:19:13 devstack cinder-volume[81927]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ddf0cd-feec-4271-a78d-77e18c82bc1d]: (4, 'qcow2') {{(pid=83061) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 02:19:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:13 devstack sudo[91333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 Apr 25 02:19:13 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:13 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9" returned: 0 in 0.551s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:13 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:13 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9 Apr 25 02:19:13 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:14 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48/volume-9762066a-04ab-41e4-a241-3afb5fe5f2f9" returned: 0 in 0.497s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-quobyte-9762066a-04ab-41e4-a241-3afb5fe5f2f9" released by "delete_volume" :: held 1.097s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG cinder.quota [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Created reservations ['06f89ed5-63ae-49a9-b6a9-a7dc1c8a5f6c', 'b4b8f289-fd65-4d57-b230-8f89adee0028', 'c1f0a4e2-cdef-47d6-bd10-0df99acde411', 'ac41a5d1-c7ff-4197-aeda-db1457d6913f'] {{(pid=81927) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9': None} {{(pid=81927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG cinder.volume.drivers.quobyte [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-557a6cc5-f056-44fc-b148-14c6b37014b9'] {{(pid=81927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.lockutils [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81927) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 02:19:14 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48 Apr 25 02:19:14 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 02:19:14 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG oslo_concurrency.processutils [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2d40bc6787f40f1323032390e9fd7f48" returned: 0 in 0.496s {{(pid=81927) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG cinder.manager [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Notifying Schedulers of capabilities ... {{(pid=81927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 02:19:14 devstack cinder-volume[81927]: INFO cinder.volume.manager [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Deleted volume successfully. Apr 25 02:19:14 devstack cinder-volume[81927]: DEBUG cinder.coordination [None req-a6539113-db5b-4105-be31-efdfd341cbcc tempest-CinderUnicodeTest-1860916158 None] Lock "cinder-9762066a-04ab-41e4-a241-3afb5fe5f2f9-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=81927) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 02:19:24 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:UPDATE=164,cinder:SELECT=110,cinder:DELETE=12,cinder:INSERT=45 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 02:19:24 devstack cinder-volume[81927]: DEBUG dbcounter [-] [81927] Writing DB stats cinder:SELECT=127,cinder:INSERT=46,cinder:UPDATE=194,cinder:DELETE=16 {{(pid=81927) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}